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DISnUBUTED WEB APPUCATION SERVER 

FIELD OF THE INVENTION 

5 This invention relates to server architectures in networked computer systems, more 

specifically to a distributed architecture for enabling the dynamic servicing to user requests 
across different machines. 

BACKGROUND OF THE INVENTION 

10 

The World Wide Web includes a network of servers on the Internet, each of which is ' 
associated with one or more HTML (Hypertext Markup Language) pages. The HTML pages 
associated with a server provide information and hypertext links to other documents on that 
and (usually) other server. Servers communicate with clients by using the Hypertext Transfer 

1 5 Protocol (HTTP). The servers listen for requests from clients for their HTML pages, and are 
therefore often referred to as "Usteners'*. 

Users of the World Wide Web use a cUent program, referred to as a browser, to 
request, decode and display information from Usteners. When the user of a browser selects a 
- link on an HTML page, the browser that is displaying the page sends a request .o ver the . , 

20 Internet to the listener associated with the Utiiversal Resource. Locator (URL) specified in^the 

_ . . link.^In response to flue request; the listener transmits the requested information to, the browser 
that issued the request. The browser receives the information, presents the received 
infomiation to the user, and awaits the next user request. 

Traditionally, the mformation stored on listeners is in the form of static HTML pages. ; 

25 Static HTML pages are created and stored at the Ustener pridir to a request from a web 
browser: In response to a request, a static HTML page is merely read fi^m storage and ^ 
transmitted to the requesting browser. Cturently, there is a trend to develop Usteners that 
respond to browser requests by performing dynamic operations. For example, a listener; may 
respond to a request by issuing aquery to a database, dynamically constructing a web page 

30 containing the results of the query, and transmitting the djaiaunoicall)^ constructed HTML page 
to the requesting browser. . To perform dynamic operations, the fin^ctionality of the listener 
must be enhanced or augmented^ Various approaches haye been developed for extending 
Usteners to siipport dynamic operations. 
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One approach to providing dynamic operations in response to requests firom web 
browsers uses the common gateway interface (CGI). CGI is a specification for transferring 
information between a listener and a CGI program. A CGI program is any program designed 
to accept and retum data that conforms to the CGI specificatioh. The program could be written 
5 ' hi any prograrbming langu Perl, or Visual Basic. 

" The CGI approach suffers from the disadvantage that a separate process (a separate 
iiistarice of the CGI prbgraih) is initiated each time the specified request is received by the 
server. Further, CGI progiraiiis execute on the same machine as the listener that received the 
browser request. Consequently, receipt of a thousmd such requests from different users will 

10 cause a thousand processes to-be initiated on the inachine ruiihing the listener ^ exhausting 
available resoiircbs on the'servef; • : ^ : - " v ^ . ; : ; 

A second disadvantage of the GGI approach is thM a separate pit)^ 
executed and terminated for each request. Thus, if a first set of teJh requests are followed by a 

' secorid set of ten requests,- a first set of ten processes will be initiated and terminated for the 

15 first set of requests and a second set 'of ten processes will be initiiated and terminated for the 
second set of reiqiiests. CGI Hoes not allbW xisiiig the same ten processes that are used for the 
first ten reqiiests to process the isbcond ten requests to avoid overhead associated with 
initiating processes. : - ^ . : . v 

An alternative approach to providing dynamic 

20 "plug-in" extensions. A plug-in extension intercepts messages sent to the server at various 
stages to perform application-specific processing for a specific uiser request. A server-side 
piug-in executes in the same address ^ace as the listener and all other server-side plug-ins. 
Hence, an application developer designing a plug-in muist be familiar with the lower level 
operational details of the Ustener. Moreover, execution of the plug-ins in the same address 

25 space as the listener exposes the listener to security arid stability risks, where a faulty plixg-in 
inay cause other pluSg-iiis or the listener itself to craish, or perform in an unpredictable manner. 

A second problern with the plug-in approach is that, si^ 
plug-in operations are performed on the same machine that is exeicuting tiie Hstenef. Because 
the tasks perforihWd by the plug-in extensions daiihot be off-loaded to other machines, the 

30 scalability of tibe plug-m approach is irignificantly lim = 
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/ SUMMARY OF IHE INVENTION - ^ . _ 

: ■ ' A method and system for handling browser requests with a distributed web application 
: server js provided: The distributed environment allows pnacess^^ 
5 perform the operations specified in the browser requests to execute on difiFerent machines than 
the listeners that receive &e ^ Because the 

. cartridge instances a^e on diSjerent machines-than the listeners, the listeners are better 
insulated against faulty qartridge instances, thus enhancing the reliability and security of the 
, system. ^In addition, the scalability of the system is greatly increased by spreading the 
10 . processing burden of executing the cartridge instancesrampng many ma^ ?3?her than the 
same machine that is executing the listener. The ability to distribute cartridge instance ' 
. . - execution across multiple machines allp\ys. numerous typ^ balancing techniques to be 

' . \used in deciding fWhen and where ta^ : . . , 

According to one aspect of the invention, an operation is executed using a dispatcHer 
15 that is exeQuting on a first machirie and a resource manager that is executing on a. second # 
.machine. A first message is^sent from the .dispatcher to the resource manager. .The first 
■■' me$sage: identifies a particular carrtdge that is able to perform the^ operation. A second 
message is sent from the resource manager to the dispatcher. The. second message identifies a 
. J ^ particular instaiice of the particular cartridge. The particular instance is executing on a thifd 
.20"' . -machine. ; . - • , • - •;■ -r r;-- , / . . - . - 

; ; A third message from the dispatch^ ^ sent to, the pa^ 

particular instance tp; execute the operation. At least two of the .first machine, the second 
machine aind the third machine are separate macl^ . , . 

. According to another aspect of the in^ 
25 associated with browser requests is provided. , The system includes a plurality of dispatchers 
. t , . , coupled to, a plurality of web hsteners. , Eaph dispatcher of the plurality of dispatchers 

receives fi-om a corresponding web listCTer,of the plurality of web listeners browser requests 
f : received by the corresponding web Ust^ , . 

The system farther inck^ The 
30 virtual path manager is coiq)led to the plurality of dispatchers thrpugh an interrmachine 

communication mechanism. The virtual path manager indicates to the dispatchers which of a 
plurality of cartridges is associated with the browser requests. The resource manager is 
coupled to the plurality of dispatchers tlu-ough the inter-machine commimication mechanism. 
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The resource manager is configured to assign to each dispatcher of the plurality of dispatchers 
an instance of a cartridge of the plurality of cartridges in response to receiving a request for an 
' instance fix)m the dispatcher. : : . : 

The plurality of dispatches are configured to send messages thix)ugh the inter-machine 
5 communication mechanism to the instances that are assigned by the resource manager to the 
dispatchiers. The rtiessages cause the instances to perforin the operations associated with the 
browser requeistsl^^ - ■ - ^ - 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 : The present invention is illustrated by way of example, and not by way of limitation, in 

the figures of the accorhpariying drawings and in whi^ 
^ similar elements- and in which: \ ^ / v ^.: • ; ^ 

Figure 1 is a block diagram of a computer system upon which "an embodiment of the 
invention may be implemented; '^ • ' - C- • 

15 Figure 2 is a block diagram of a distributed application server accord^^^ - 

embodiment of the invention; ^ ' -'^ : . 

Figure 3 A is a portion of a flow chart illusti^ating steps for handling a browser request 
according to an embodiment of the invention;- ' ' ' ' 

Figure 3B is another portion of the flow chart illustrating steps for handling a browser 
20 request according to an eihbocfiment of the invention; - - ^ - 

" Figure 4 is a block diagram of a table containing inforaiatibn maintained by a 
dispatcher according to an embodimeMof the inventioii; and 

Figure 5 is a block diagram of a table containing information maintained by a resource 
manager according to an embodiment of the invention. : ; 

DETAILED DESCMPTION OF THE PI^EFElUlEDElVffiO ' 

A metiiod and apparatus for perfonnihig operations over a network is described. In the 
following descriptibn, for the purposes of explanatioti, numerous specific details are set forth 
in order to provide a thorough understanding of the present invention. It will be apparent, 
30 however, to one ^Iled in the art that the present invention may be practiced without these 
specific details: in otiier instances; weU-khbvra structitres and devices are shown in block 
diagram form' in order tb avoid unnebessarily oT^sciiring tHe'|>rreeht invention. 
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HARDWARE OVERVIEW - . ^ 

.... Figure 1 is a . block diagram that illustrates a computer system 100 upon which an 
embodiment of the invention may be implemented. Computer system 100 includes a bxxs 102 
or -other commxmication mechanism for CQTnmum'catipg tTifnrmatinrij and a.pTYicessnr ] Qd 
: 5 , coupled with bus 102 for processing information. Computer system 100 also inc^ a main 
memory. 106, such as a randoin access memory (RAM) pr other dynamic storage device, 
coupled to bus 102 for storing information and instructions to be executed by processor 104. 
Main memory 106 also may be used for storing temporary variables or other intemiediate 
information during execution of instructions to ]?e executed by processor 1 04. Computer 
. 10 system 100 further includes a read only memory (ROM) 108 or other static storage device 

coupled to bus 102 for storing, static infpnnation an A storage 

device 1 10, such as a magnetic disk or optical disk, is provided and coupled to bus402 for 
stomg iirformation and ins^ . . ^ . ^ 

Computer system 100 may be coupled via bus 102 to a display 1 12, such as a .cathode 
15 ray mbe (CRT),-for: displaying irifo An .input device 114, - 

including alphanmneric and other keys, is coupled to bus 102. for communicating information 
^ and conmiand selections to processor: 104. Another type of user inpyt device is cursor control 
116, such as a mouse, a trackball, or cursor direction keys for coromunicating direction- r 
information and command selections to proc^sor 1 04 and for controlling cursor movemCTt on 
20 display 112. This input device typically has two degrees of freedom in two axes, a first axis 
(e.g., x) and a second axis (e.g., y), that allows the. device to specify positions in a plane. 

The invention is related to the use of computer system 100 to perform specific 
operatioiis in response to messages from browser According to one embodiment of the 
invention, the operations are performed by computer system 100 in response to processor 104 
25 executing one or more sequences of one or more instructions contained in main memory 1 06. 
Such instructions may be read into main memory 106 from another computer-readable 
rnedium, siich as . storage device 1.10. Execution of the sequences . of instmctions contained in 
main memory 1 06 causes processor 1 04 to perform the process steps described herein. In 
alternati ve, embodiments, hard- wired circuitry, may be i^ed in place of or in combination with 
30 - software instructions to implement the. invention. Thus, embo^i?nOTts. of the invention are not 
. liniited to any specific combination of hardware circuitry and. sqf^ : , , , 

The term "coriiputer<*eadablj5 medixira" as ^^-^Y medii^m that 

participates in providing instructions to processor 104 for execution. Such a mediimi may take 
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many forms, including but not limited to, non-volatile media, volatile media, arid transmission 
media. J^on-volatile media includes, for example, optical or magnetic disks, such as storage 
device 110. Volatile media includes dynamic memory, such as main memory 1 06. 
Transmission media includes coaxial cables, copper wire and fiber optics, including the wires 
5 that comprise bus 102. Traii^mission media can also take the form of acoustic or light waves, 
such as those generated diiring radio-wave and infra-red data coihmunications. 

Common forms of computer-readable ihedia include, for exainple, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other maLgjietic medium, a CD-ROM, any other 
optical medixmi, punchcards^ papertape, any other physical mediuin- with pattems of holes, a 

10 RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a 
carrier wave as described hereinafter, or any other medium from which a computer can read. 

Various forms of computer readable media iriay be involved in carrying one or more 
sequences of one or more instructions to processor l G4^f6r execution. For example, the 
ihistmctions may initially be carried on a magnetic disk of a remote computer. The remote 

15 computer can load the instructions into it^ dynaiiiic membry 'ahd serid the instructions over a 
telephone line using a modem. A modem local to computer system 100 can receive the data on 
the telephone line and use ah infra-red transmitter to convert the data to an infra-red signal. An 
infra-rdid detector coupled to bus 102 can receive the data carried in the- infra-red signal and 
place the data oii bus 102^ Bus 102 carries' the data to main rxiemory 106, from which processor 

20 104 retrieves and executes the instractions. The instructions received by main memory 106 may 
optionally be istofed on storage device llO either before or after execution by processor 104. 

Computer system' 100 also include a cornmiimcation interface 118 coupled to bus 102. 
Commuiiication interfece 118 provides a two-way data cbmmimication coupling to a network 
link 120 that is connected to a local network 122. For example, communicatioh ihterfiace 118 

25 may be an integrated services digital netwbrk (KDN) card or a niodem to provide a data - 
commimication cdrinection to a corresponding type of telephone line. As-another example, 
communication interface 118 may be a local area network (LA^O <^d to p^ data 
commimicatioriccririeJctiontoacornpatibleL^ In 
any such implementation, commiinication interface 118 seiids and receives electrical, 

30 electromagnetic or optical signals that carry digital data streams representing various types of 
infbrmatiQn. ^ " v - . . . v l > : - — . 

Net^oirk liEJc" 120 typically" provides data cbminimicatibn- through one or more 
networks to other dsita devices." For example^ hetwdrk link 120 rhay provide a cormection 
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through local network 122 to a host computer 124 . or to data equipment operated by an 
hitemet Service Provider (ISP) 126. ISP 126 in turn provides data communication services 
through the world wide packet data communication network now commonly referred to as the 
"Internet*' 128, Local network 122 and Internet 128 both u§p electrical, electromagnetic or 
5 optical signals that carry digital data streams- Ilie signals through the various networks and 
the signals on net>york link 120 and through conmunication .interface 118, .which carry the 
digital data to and from computer system 100, are exemplary , forms of carrier waves 
transporting the infprmation^^^^ - : . :^ . ; :- 

, , Computer system 1 00 can.send messages, and receive data, including program code, 
1 Q through the netwprk(s), network lipjc 1:20 and communication interface 1 1 8. In the Internet 
— example, a server 130 mghtjtnuj^^ requested code, for an application program through ' 
Internet 128, ISP 126, local ne^^ork.122 and communication interface 118. 

. , The received code-njay b.e executed by processor 104 as it is received,. and/or stored in 

- storage device 1 10, or other non-volatile storage forlatpr execution. . In this inaiiner, computer 
15 system - 1 00, may obtain application code in the :form of a carrier wave, ^ M- 

^ . ^ FUNCTIONAl. OVERVIEW . : 

: , ; : , -Figure 2 is^a-block diagram of a system 200-designed according to an embodime;it of 
, the invention. The system 200 includes a plurahty of browsers 202, 204 and 206 that 
20 comrnunicate with a plurality qf hsteners ? 1 0, 2 1 6, and 222 oyeic the In;temet 208 according to 
; -^.the HTTP prptpcol. In response to requests from the browsers, ?the listeners pause a web 
. . : application server 280 to invoke software.modules, referred to herein as cartridges. In the 

illustrated embodiment, web apphcatipn server 280 has initiated the execution of three 
: cartridges 230, 234 and 238-. , . :^ ^ . . . . . . .... 

25 , , r Thejweb applicatiOT server 280 is composed of numerous components, including 
. , ,^.transport.adapters.212, 218 and 224, dispatchers 2 14,. 220 and 226, an authenticatipn server 

- 252,' a virtual patii manager 250, a i^ource manager 254, a. configuration provider 256 and a 

. plurality of cartridge execution engines 228, 232 and 236. The various components of the web 
application server 280 ^all be described hereafter in, greater detail. . . ^ 

30 . Significantly, .theouumerous components of web apf>li$:at|9n §e|rver 280 communicate 

through an inter-machine communication mechanism, such as an Object Request Broker 282. 
JJsing an inter-machine communication, mechanism, cartridge. instmp« perform the 

f r ; .operations specified in browser requests may escecujte on.diJBferent machines tiian the listeners 
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that receive the requests iand the browsers that issue; the requests. Because the cartridge 
instances are on different machines than the listeners, the listeners are better insulated against 
faulty cartridge ihstances, thiis enhancing the rehability and security of the system. In 
addition, the scalability of the system is greatly increased by spreading the processing burden 
5 of executing the cartridge instances among niany machines, rather than the sarnie machine that 
is executing the listener! Tlie ability to distribute cartridge uastance execution across multiple 
machines allows numerous types of load balancing techniques to be used in deciding when 
and where to spawn new cartridge instances. 

A typical operation within system 200 generally includes the following stages: 
10 A browser transmits a request over the Internet 208. 

A listener receives the request and passes it through ia traiisi)drt adapter to a dispatcher. 
The dispatcher communicates with the virtual fjath manager 250 to determine the 
appropriate cartridge to handle the request. 

At this point the dispatcher does one of two things. If the dispatcher knows about an 
1 5 unused instance for that cartridge, the dispatcher siencis the requeist to that instance. If there 
are no unused cartridge instances for that cartridge, the dispatcher asks the resource manager 
254 to create a new cartridge instance. After the instance starts up successfully, the cartridge 
notifies the resource manager of its existence. The resource mariageb: 254 then notifies the 
dispatcher of the new uistance. The dispatcher ci-eates a revised reqtiisst based on the browser 
20 request and sends the'revised request to the new iristaiice. 

The cartridge instance handles the revised request and sendis a response to the 
dispatcher. - . ... 

The dispatcher passes the response back tteough the listener to the client. 
These stages shall be described in greater detail hereafter. 
25 ^ ' 

CARTRIDGES ' ' " 

Cartridges are modules of code for performing specific iappUcation or sy^em 
functions. A cartridge forms the basic imit of distribution in the systein 200. * According to 
one embodimmt of the invention, cartridges are named lising Uhiveikal Resource Locators 
30 (URLs). Thus, a cartridge name has two parts: the IP address of the server on which the 
cartridge resides, and the virtual path in the server directory sthicture of the compiled 
cartridge code. Because cartridges are nined'using'URLs, the cartridge name space is global 
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and cartridges may be arcessed.u^g the„same messaging tTC as, are used to access 

other web resources,, such as doQimients. , 

. - According to one embodiment of the invention, each cartridge has a standard interface 
which provide a common overall structure for all cartridges. The standard interface defines 
the interface of routines that are invoked by the web application server 280 under particular 
conditions. According to one embodiment of the invention, the abstract cartridge interface is 
as follows: , . . , ^. 

interface Cartridge « _ - 

■ ^ - - ■ - ■ r - 

boolean initO; - . 

boolean authenticate(in Principal user_passwd); 
„ boolean e?^ec(in Request req_obj, out Response resp_obj); 
boolean shutdownQ; 

The. initO routine is responsible for intializing the cartridge instance. This may include 
invoking the constructors of several subobjects, preforking threads and acquiring all other 
. required shared respiirces. : , . . .. ,^ ^ ...^ 

The shutdownQ routine is responsible for cleaning up all of the resources and shutting 
down the cartridge instance.. Once the shutdovraQ routine is invoked on a cartridge instance, it 
iixunediately becomes unavailable for servicing subsequent requests. 
: The authenticateQ routine validates whetlier the client requesting the services of the 
cartridge is authorized to use those services. 

. The execQ routine is the generic way to dispatch all service requests to the cartridge. 

EXEl^LARY CARmiDGES 
Each cartridge is either configured as a cartridge that performs a well-defined fimction, 
,or as a programmable cartridge that acts as an interpreter or a routine environment for an 
.^pUcation. An example of a programmable cartridge is a PL/SQL runtime, configured to 
process database queries according to the Oracle-based Programming Language using 
Structured Query Language (PL/SQL). The PIVSQL runtime executes a browser r^uest 
having a database query. The PL/SQL runtime pirocesses tie request, for example, by 
accessing a database server in.commiinication with the cartridge instance via* a data Imk. 
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Another example of a prograxnmabte cartridge is a JAVA runtime interpreter: The , 
JAVA runtime interpreter cartridge enables web application developers to write server-side 
JAVA applicatibris to process browser requests. Similarly, a custom server may be configured 
as a cartridge iii order to provide dynamic operations such as, for example, accessing 
5 processes executed by a third party server. 

DISPATCHERS 

Dispatchers are software modules configured to route the requests received by listeners 
to the appropriate cartridges. According to one embodimeht of the invention, dispatchers are 
lO' implemented ais server-side program extensions (i.e. "plug-ins")*- As such, the dispatchers are 
- loaded into and execute within the same address space as ttie listeners to which they belong. 
The dispatchers may be linked with the UstenetHCdde-at compile time, or dynamically loaded at 
runtime. : . z,' .< - \ . 

In the illustrated embodiment, dispatchers 214, 220 and 226 are associated with 
15 listeners 210, 216 and 222, respectively. Dispatchei^ 214, 220 and 226 selectively route 
browser requests received by listeners 210, 216 and 222 to cartridges. 

For example, assurhe that Ustener 210 receives a browser :request over the Internet 208 
delivered in the form of a Uniform Resource Locator (UKt).^ The browser request serves as 
an identifier for a vveb objebt, for example an HTML page' or an operation to be performed. 
20 The listener 2 1 0 hands off the browser 'requ:est to dispatcher 2 1 4 without any. attempt at 
interpreting the browser request. Upon receiving the browser request, the dispatcher 214: 

(1) commimicates with virtual path manager 250 to identify a cartridge selected by the 
browser request and to determine whether the cartridge requires autiieiitication, 

(2) if the cartridge requires authentication, conununicaites with the authentication 
25 server 252 to determine whether the browser is allowed to access the selected cartridge, 

(3) if access is authorized, comniunicaLtes witii the resource manager to determine the 
specific instance of the iselected cartridge to which-the browser request shoiild be sent, and 

(4) creates arid dispatches a revised browser request for execution by the specified 
instance of the cartridge. - ^ 

30 The revised browser request repackages infbrination received in the original browser 

request. The revised browser request may include, forexaniple,^ a context object that contains 
data required for the proper dp^tion of^the d^tridgfe.- The data reiquired for proper operation 
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of a cartridge may include, for example, a transaction ID that identifies a transaction with 
which the browser request is associatei . : : . 

'If the cartridge, replies to the request, the cartridge sends the reply to the dispatcher and 
the dispatcher passes the reply up to the listener for transmission to the browser- that initiated 
5 the request. . - . ; , .: \ -.r -r, 

CONFIGURATION PROVIDER 
According to one fimbodirnentjDf the invention, cartridges that are to be used with web 
application server 280 are; fir^ regist^edrwith web .application server 280. During the 
-10 registration process, inforrhatioij* about-the cartridges is supplied to tl^ configuration provider 

256; Configuration^prQvider 256 .sipres the information as. metadata 258 for later access by 
^ ^ the components of the web:application. server 2_80.i -i,^ ^ -.j .T 
The metadata 25 8 may include, for example, 

(1) the cartridge naiiie; : . : jv: - . : ; . : . ^ - # 

15 ' (2) the niimmum.number of reqiiiired instances; _ " . ^ 

(3) the maximimi.numbej:Qf instances;, v . . v , - % 

- (4) the location of toe code that/implenxents; the car^ >- 
: " - ; (5) the program-dependei^t^iunction n used by the cartricige execution engine tp 
execute the callback flmction? (initial |: 
20 (6) alistof machtoes forrui^^ : ; r . .1: t 

(7) the idle time for the cartridge (the amoimt of time instances of the cartridge are 
allowed to remain idle before they are. shutdown)^ ; • w 

(8) an object identifier; and . , . , , - , , 

(9) data indicating the. type of authaitication service, if any, -to be used with the 
25 cartridge, • \. ; - r, . 

r \ : _ The object identifier specifies tiie data that must be supplied by a browser request for 
requesting performance of an opei;a)ion by tbe pprresponding cartridge. The,object type may 
be a specific word, a URL, or may>include a virtual path.such as "/java". 

Once the configuration provider 256 has stored the configuration information for a 
30 particular cartridge in the metadata 258,.that cartridge is automatically registers when web 
, appUcation server. 280 is started. r ^ 7 .jl'^ 

:::: After a cartridge isregisteTediJ^^ 
manager 254 initiates die minimum instances for the cartiidge. Once the minimmn number of 
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instances has been imtiated, the web application server 280 is prepared to process browser 
requests. 

THE VIRTUAL PATH MANAGER ^ 
5 As mentioned above, dispatchers communicate with the virtiial path manager 250 to 

determine where to route each revised browser request. Specifically, each browser request 
typically includes a URL. Upon receiving a browser re^tiest, the dispatcher sfends the URL in \ 
the request to the virtual path manager 250. The virtual path manager 250 responds by 
sending the cUspatcfieir data thiit identifies the cartridge, if any, {associated with the URL. 

10 " In order to supply the required information to dispatchfefs, virtual path manager 250 

consults the metadata 258 that miaps URLs to cartridges. In response to receilnng a browser 
request, the virtual path manager 25d usies the mapping data to deteraiine the cartridge, if any, 
to which the URL contained ill the browser' requests com 

For example, if the browser request is a URL request beginning with the virtual path 

15 "/Java", the mapping may indicate that 'the JAVA mterpreter cartridge iis configured to handle 
fequeste having the virtual path 'Vjava**!;^ 

According to one eriibodimeht of the invention, the virtual path marikger 250 also 
detemiines whelther the cartridge associated with the URL requires duthentication. If the 
cartridge requires authentication, the virtual path manager 250 indicates in the response that 

20 the virtual path manager 250 sends to the dispatcher that aiuthentication is required. If 

authentication is not required, the dispatcher creates and sends a revised browser request to an 
instance of the cartridge witiiout invoking the authentication server 252. If authentication is 
required, the dispatcher sends the revised request to an instaiice of the cartridge only after the 
authentication server indicates that the revised request may be subn^tted to an instance of the 

25 cartridge. 

" THE RESOURCE MANAGER " ' ' 

The resource manager 254 of the web appHcatioh server 280 manages the execution of 
each of the cartridges by initiating a predetermined minimum niunber of instances for the 
30 cartridges, load balancing between the instances of each cartridge, and initiating new instances 
of cartridges as necessary up to a predeteriidned maximiun nmnbCT of instances of a given 
carfridge.-*' ' ■• ' ^ * - — 
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; . . ; • Fqi'- example, asgiaine that the metadata for a particular cartridge (CI) includes the 
following infonnation: 
Name = CI 

Minimum Instances = 10 ... 
. Maximum Instances := 50 

HostMachines = Ml,M3,M8_. 

idle time = 30 seconds . . , . . 



Based on this me t ada t a, when cartridge C.l is firsj registo-ed, resource manager 254 
10 . will initiate ten instances of CI- Resource manager 254 will initiate flie.ten instances on the 

machmes associated v^tb the l^els M ' 

, ; Upon receipt of requests from 

determines whether any existing instance of C I is available for use. If no instance of CLis 
available ^hen a r^uest is received, respurce manager 254 determines whether the maximum 

1 5 number of instaiipes of C 1 are already ruiming. If the maximum number of instances of G l 
are not ah-eady ranning, then resource manager.254 initiates a new iristance of C I on pnepf 
the possible host machines and transmits a message that identifies the new instance to the, 
dispatcher that issued the request. If the maxumim numbea* of instances of CI are already t> . 
running, then resource rnanager 254 sends a message to the dispatcher that issued tiie request 

20 to indicate that the jequest cannot be handled at this time. . . 

. . LOAD BALANCING , 

According to one embodimmt of the invention, resource manager 254 applies a set of 
load balancing rules tQ determine where to initiate instances of cartridges where there is more 

25 than one possible host machine. Thus, in the above example. Ml, M2 and M3 aire all capable 
of executing instances of cartridge CI . If Ml, M2 and M3 have the same processing capacity, 
it may be desirable to distribute the instances evenly across the three machines. However, if 

_ . Ml has ten times the processing.power of M2 and M3, it may be desirable to initiate all 

instances of CI on Ml ufj to a certain point, and then to distribute additional instances evaily 

30 among Ml, M2 and M3. ^ ' r 

. To assist resource manager 254 in detenmning how to load b^ance among possible 
machines, the metadata stored for each cartridge may include additional details. . For example, 
the metadata may specify a separate minimum and maximum number of instances for each 
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machine. Resource manager 254 may then distribute new instances among the machines 
based on which machine has the lowest ratio of actual instances to TriaviTniim instances. 

The mejadata.may also specify an order for the machines that can run a cartridge. The 
machine at the N-hl position in the order is only used to execute instances of the cartridge 
5 . whep the machine at the Nth position in the order is already executing its maximum number 
ofinstances^ -T: . :\ ■: 

CARTRIDGE INSTANCE STATUS: TRACKING 
According to one embodiment of the invention^ the iresbiirce^^m 

10 state information to keep track of cartridge instances that have been created. The state 

information includes data; that identifies the ihstance;ndentiiSfes the machine executing the 
instance, and identifies the. listener to "which the instance has been assigned. . 

Figure 5 illustrates a table 500 that may be maintained by resource manager 254 to 
store this state information. Table 500 includes an instance column 502^ a cartridge coluirm 

15 504, a listener coltunn 506 and a machine colimm' 508:. Ea;ch row of table 500 corresponds to 
a distinct cartridge iiistance. Within.the row for a given cartridge instance, cartridge column 
504 identifies the cartridge associated Svith the ^cartridge instance aiid instance coliimn 502 
indicates the instance number of thexartridge instsince; For example, row 510 corresponds to 
an instance of cartridge CI : Therefore, cartridge column 504 of row 510 indicates cartridge 

20 CI. Instance colxmin 502 of row 510 indicates that the cartridge instance associated with row 
,510 is instance l.of cartridge CI: : . ■ ^ ' " - ^ 

.Listener column 506 mdicates the listeiier to which thfe cartridge iiistarice associated 
with a row has been assigned. Machine colmnn 508 indicates the machine on which the 
cartridge instance associated with a row is executing. For examjple)- the cartridge instance 

25., associated with row 5:1 0 has been assigned to listener 21 0 and is executing on machine Ml . 

Similar to resource manager 254, each dispatcher maintains state information for the 
cartridge instances that have been assi^ed to the listener to which the dispatcher is ytached. 
Such state information may be maintained, for example, in a table 400 as shown in Figuire 4. 
Similar to table 500 j table 400-includes an instance column 402 and a cartridge colmnn 404 

30 that respectively hold instance nxmibers andicartridge identifiers. However, while table 500 
includes one entry >for every cartridge instance ^assi^^ resoicrce manager 254,. table 400 

only includes entries forxartridge instances that have Been assigned to apiarticular listener. 
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For example, table 40Q includes entries for only those eartridge instances liked m table 500 
•that have been assigned to listener 210.. . . . - > ' 

.: In addition to instance colunm 402 and cartridge coluinri 404, table 400 includes a 
status colunm.406.: For each.row, the status column 406 holds a valiie that indicates the status 
5 of the instance associated with the row. For example, the status column '406 of row 408 
indicates that instance 1 of cartridge CI is currently busy. In the illustrated embodiment the 
status column 406 holds a flag that indicates that a cartridge instance is either BUSY or FREE. 
The significance of the cartridge state shaM now be describe with reference to the operation 
of resotarcemanager.254.«md:dispatchers214 and220. 
10 ^ ■■ \: Z ^ " ' ' =. v ."• ■ . 

. ilNTnERACnQN BETWEEN DISPATCHERS AND 
..-THEzRESOURCE MANAGER- ' 
As explained above, dispatchers communicate with resource manager 254 when they 
a revised-browser request to'a particular caito ■■•^'^ 
15 , embodiment of the inventio^i, dispatchers .first deteimine whetiier an instance of the ■ ^ ^' 
appropriate, cartridge (1) has akeady been assigned to it abd (2) is available to process die Mw 
: revised browser request If an appropriate cartridge instance has akeady been assigned to thfe 
, di^atcher and is, cmrraitly available ;to process jthe. new revised browser request, then the 
-. dispatcher forwards the revised browser request to the carifedge^ instance vwthout further " '-^ 
20. cp m mumcationjvitjh resouTCe.m . ; - . j,.:- : ■ . 'J'. 

For example, assume that listenw 210 receives a browser reqiiest that; acebrding-to 
virtual path. manager. 250, -must be processed by cartridge CI. Assume also that-table 400 
reflects the current list and status of cartridge instances that have been assigned to listener 
210., Upon receiying the browser request from listener 210, dispatcher 214 inspects table 400 
25 , to locate a FREE instance pf cartridge CI.. In the illustrated table 400^ row 410 indicates that 
' instance 3 of cartndgeCl is currently FREE. Consequently, dispatcher 214 forwards a 
, ^e^ased browser request directly to. i^^ without further communication 

- ..-"^*^:'"esource manager 25^, ,In response to sending: the revised^browser request dispatfeher 
2 14 changes &e status value in status column 406 of n>w, 410 to BUS^^ 
30 5 . If a listens has notaliTsady been assigned an ^propriatecartrid 

currently available, then t^e dispatcher associated with the cartridge fiequestsva cartridge 
instance, from the respurpe manager 254. :If:the resource manageE<254j detomines that an- 
instance of the required cartridge is not available and the number of existing instances of the 
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required cartridge is below the maximum, then the resource manager 254 initiates a new 
cartridge. Upon initiating a new cartridge, the resource nianager 254 inserts an entry for the 
ne\v cartridge instance in table 500. - 

Assume,- for example, that listener 21 0 receives a browsK* request titat must be 
5 processed by cartridge G3 . Assume also that instance 3 of cartridge C3 has not yet been 

initiated. Under these conditions, dispatcher 21 4 sends to resource manager 254 a request for a 
handle to.an instance; of cartridge G3. In response to this request, resource mkhager 254 
initiates instanced of cartridge C3 on machiiie M3. to addition, resoiffce manager 254 inserts 
into table 500 the entry found at row 512. ^ . 

10 : : ;: After inserting row 512 for instanced of c^itrid^^ 

254 sends 'back to the dispatcher 214a handW to the newly created instance. In response to 
receiving;this handle, dispatcher 214 inserts an entry (r6w 4 12) -for the new instance in its 
. status table 400. The dispatcher 214 then transnaits a revised browser request to instance 3 of 
■ cartridge G3. " ..'^ 'v^'- -^'-^ . - ^ . : 

RELEASING CARTRIDGE INSTANCES ^ ' ^ 
Accordinjg to one embodiment of the iiiverition^ listeners do not automatically release 
: ownership of cartridge instances when the cartridge instances finish responding to outstanding 
browser requests. For example, assume that instance 3 of cartridge G3 recei ves a revised 
20 1 browser request, processes the revised browser request, and sends a response back to 
; . dispatcher 214. Dispatcher 214 passeis the response to listener 2ld to be seiit back to the 
^b^owserithat issued the browser request ^'^^^ ^ ^ ^ ' ^ " ^ ^ ^ " • 

At this point, listraer 210 no longer requires ownership of instance3 of cartridge C3. 
However, rather than transferring ownership of instance 3 of cartridge C3 back to resource 
25 manager 254, dispatcher 214 mwely changes the status column 406 of row 412 from BUSY to 
r FREE. - v " : V. .-^ ^ • ' - - 

: ' Changing the value in status colunm 406 of row 412 to FREE indicates that instance 3 
of cartridge G3 is no lotiger working- on a request, and is therefore ready to handle subsequent 
requests. However, because table 400, which indicates that instanced of cartridge C3 is 
30 available, is maintained locally by dispatcher 214, instance 3 of cartridge C3 is only available 
c for subsequent browser requests arriving at listener 21 0, Row 5 12' of table 500 maintained by 
resource manager! 254 continues to indicate that instonbe 3 of cartridge G3 is owned by 
Ustener 210. 
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- Because Usteners.do not automatically release cartridge instances eveiy time a request 
. is serviced, overhead associated, with communication between the resource manager 254 and 

the various dispatchers is significantly reduced. For example, assume that a Ustener 210 
. receives .ten successive requests that must be communicated to cartridge C3: Rather than 
5 cpmmunicating \vith .rcsource manager 254 for each of the ten requests, dispatcher 214 i6ay 
. , conmiunicate.withresoiffcemanager 254 in response to.thefi^^ 
. ...requests .can be handled by:(Uspat^^^^ 

because the dispatcher 214 usK the, sam^ 

process the nine subsequent requests. ■ . : . 

^ - . . WMle-not.automatically releasingJistener ownership of cartridge instances when each 
request is serviced cm increase the^e of-web .appHcation server 280, listfeners cannot ' 

maintain OAvnership of cartridge ,in?tances indefinitely. For example,;instances that have not 
been used for long periods pf.time, should be passed back to the r^ource manager 254 so they 
can be de-allocated to fi-ee up resources. In addition, it is not efficient for one listener to- 
1 5 mamtain ownership of the instance of a cartridge that it has not used for a relatively long time 
when other listene^. require instances of that cartridge. 
... Consequently, resource manager 254 communicates to each listener a maximum^dle 
. , . t^me for each cartridge, instance^ p^sed to the, listeaier.. The: maximum idle time indicates the 
. , maximum .amount of time a cartridge instance can go unuied before thedistener must release 
20 ownership of the car^dge instance. For example, assume that the resource-manager 254 ■ - 
, , .indicates to list^er 21 0 that the maximum amount of idle time; for iiistance 3 of 'cartridge C3 
is 10 minutes. Based on this information, Ustener 210 may continue; to use instance 3 of 
cartridge C3 to process browser reques^ for cartridge C3 as long asinstahce 3 of cartridge C3 
do^ not remain idle or FREE -for more than 10 minutes. ; - .. /. . . ■: 

^ 25 . - ;- If instance 3 of cartridge C3 is idle for more than 1 0 minutes, dispatcher 2 14 removes 
row 412 from table 400 and sends a message to resource manager 254 that Ustener 210 is 
. '^^^^g P^^^hip pf instance,^ of cartridge C3. IpresponseJo this message, resource 
. : . -P^^g^ 254 updates.row 512 to indicate that instance 3 of cartridge C3 is not owned by any 

, hsteiier and may thus bejeassigned tp another Ustener or; terminated;. ■'• -). 
30 : . In a? alternative embodrarat, 

^ . mstances when the idle tiipe for the-Gartridge instance has. expir^i. Instead^ the dispatcher 
sends a message to resource macia^er 254 ofiFering.tp release, the expiredinstance. Resource 
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manager 254 may respond to the ofTer by requesting that the listener release the cartridge 
instance, .or by allowing.the listener to retain ownership of the expired cartridge instance. 

According to one embodimCTit of the invention, resource manager 254 iriaiiitains a 
queue of the . requests that cannot be immediately senaced. When it becomes possible to 
5 service a queued request, the request is removed from the queue and processed. ' 

For example, assimie that listenisr 222 receives a browser request that mxist be 
processed by cartridge CI, and that liistener 222 has riot been assigned any instances of' 
cartridge CI . Dispatcher 226 sends a request for an instance t)f dl to resource manager 254. 
Assume further that a maximum: of 50 instaribes bfCl are allowed; and that 50 instances of 
10 CI have been assigned to listener 210. Under these cbnditioiis, resource manager 254 cannot 
: service the request from listener 222. -Therefore, resource manager 254 puts the tequeist on a 
queue. When listener 210 releases ah instance of G l , resource m communicates to 

listener 222 that an instance of Gl is available. ^ - ^ - 

Under certain conditions, resource manager 254 may predmptiVeily cause k listener to 
15 release a cartridge instance. For example, resource manager 25^^ delect a system 

overload situation and respond by terminaiting a set of cartridge instaiices, either befbfe or 
after infortning the listeners that currently have been assigned the cartridge instances that the 
cartridge instances ire going to be terriiinatied. - • ' 

Resoin-ce manager 254 may also preemjptively ca^^ 
20 instances lo inciplCTient fairness policies'between i^^^^ For examjple, res6xu-ce riianager 

. .254 may cause a listener that holds.the most instances of a given* cartridge to release an 
: iiistancetoftfie cartridge wheri ahother listener has waited niore than a prodettonined 

threshold 'of amount of traie-for ah instance of the cartridge. For example, if listener 210 has 
been assigned 50 instances of cartridge CI and CI has a TnayiTnum of 50 instances, then 
25 resource manager 254 may cause listeher- 210 to releiase an instance of C 1 ten seconds after 
receiving a req\iest for an instance of CI frbm another listener. 

^ CARTRTOGEIEXEGUTiON ENGINES \ 
■ According to one embodiment of the invention, each cartridge Instance is composed of 

30 a cartridge execution engine iand a'biartridge. A cartridge execution engine is a code module 
that insulates cartridges from the complexities of the web appficatiori server 280 and the inter- 
module conraiuhicSdon im^TC^^ made available to a cartridge eicecution 
engine by storing in a function table pointers to the cartridge functions:- Ac6ordiig to 6ne 
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, embodiment,, all cartridges provide the functions specified in the exemplary cartridge interfece 
de5c4bp4 above. By having all caartridges support the same interface, a single standard 
cartridge execution engine can be used with aU cartridges. . :^ 

According to one embodiment of the invention, cartridges arei implemented as shared 
5 libraries, and cartridge execution ra^es are executable pnagrams.that invoke the routines iii 
the shared libraries using the standard, cartridge interface. The cartridge^executibn engine 
provides the interface ,bet>veen cartridges and the dispatcher, difectsxartridge flow of control, 
^ and provides services for .cartridges to use. - . : - . . *. . ; ' : 

_ . When the resource manager 254 requires the Creation of a new cartridge instance, the 
1.0. . resource n^^ager 254 causes a cartridge execution, engine to .be instantiated; In turn, the 
. instancy ofHic carrtdge executionreagine thus created causes^ the appropriate cartridge- to be ' 
instantiated. The resource manager 254 can cause tfie cartridge Execution engiiie to be 
instantiated, for example, by invoking a "cartridge execution -.engine, factory" that resides on 
, the machine pn which cartridge is to be executed. ^ The mstance. of the cartridgi&rexecut^^ 
1 5 engine can qause the cartridge to be instsuitiated, for example, by making a call to^one of the 
routines in the shared library that cpnstitutes.the- cartridge.^ 

. . . . As shownin Figure 2, the webjappUcatipn iKver 2 80 mcludes cartridge execution - 
engines 228, 232 and 236 for each of the cardidges 230, ,234 and 238. Thexartridge ; r^-:;^:^ 
?xecvtion engines control exectition of the instances ofthe :CorresF«>nding cartridg€S5a)y^ 
20 making .calls into the cartridges- through the standard cartridge interface. By establShing.basic^ . 
callback fimctions between the. carQidge exTCuti engine . ^nd a cartridge, ;any cartridge can 
be integrated into the weh appjication server 280 by configuring the cartridge tO)respond to the 
callback functions, and then registering the cartridge in the configuration provider 256, as 
described below. , ? . . . t 

25 Thus, if the dispatcher 2 14 detemiines that th& PL/SQL runtirne partridge is the 
appropriate cartridge to process a request, ;the dispatcher .214^dispatches the request to a . 
cartridge instance that includes a cartridge execution engine associated with the PL/SQL 
runtime cartridge. If ^ netw instance needs to be iidtiated, the resource manager 254 creates a 
' . : instance of the PL/SQL runtinae cartridge in a. separate address space gjui dispatches the 
30 request to the cartridge execution engine 228 of the new instencev>. §pace used to 

^ . execute the instance of the program may be .wifliin memoiy. qf jflre cpmputeF system upon , 
^ybicli one pr more of tiie compoiiiCTts of web- appUcaricm servCT^^^^ 
another computer system.. ^ - . ^; .'^ ^ - ' .v^*.:.-^ ftl . ' 
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In response to a message from a dispatcher, the cartridge execution engine issues a 

request handler callback function to the cartridge, causing the cartridge to process the request. 
The cartridge executing the request returns the result to the cartridge execution engine, which 
forwards the result to the dispatcher, hi the event that the web ^plication server 280 detects a 
5 fault in the operation, the cartridge execution engine issues a shutdown function of the - 

'\ cartridge.". ■:; * ' r.. : ■ ■ ' 

Hence, the cartridge execution engine provides an application programming -interface 
to the web application server 280 that ^ecifies predetennined operations to be perforaied. 
Use of the standard cartridge interface enables prograimners of the cartridges to configure 
1 0 . each cartridge for higfclevel integration into the web application server 280 indepradent of 
: ; the protocols used by the particular web listener with which' the caitridge will be used. 

TRANSPORT ADAPTERS V ' ^ ^ ^ 
■listeners enable:the iise of seiver-side plug-ihs by providing a programming interface 
1 5 - and protocol for use by such plug-ins. Unfortunately^ the pmgramming interfaces arid 

protocols provided by Usteners vary from listener to listener:- For example, Netscape Server 
: Application Programmuig Interface (NSAPI), Mtemet Sefver Application Programming 
^: . to and Apphcation Developnient Interface (ADI) are three examples of distinct 

programiiiing interfaces ciirrently provided'by hsterie^^ / - ' ^ " - 
20 Transport adapters insulate dispatchers from; the proprietary protocols arid interfaces 

' used b> web listeners. Specifically, ^ach trjarisport adapter is configured to recognize the 
protocols of different listeners, and'to convert flie browser requests received frdm tiie listeners 
iritd converted broAvser requests having a standard di^atcher protocol that is independent 
from the protocol of the listener. Similarly, transport adapters convert the replies frorri the 
25 dispatcher to the transport protocol of the listeners. ' - 

• Hence, the transport adapter enables the web application server 280 to be used with 

listeners'fixJm different vendors: Moreover, transport adapters may be configured to 
accommodate different sa^er architectures m : - : ' : 

30 - OPERATION OF THE WEB APPLICATION SERVER 

Figures 3A and 3B ares a flow diagram illustrating a method of responding to a browser 
request according to ari enibodiriient of the present inveritiori. The browser teqiiest is received 
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in step 350 by a listener. For the purposes of explanation, it shall beasstimed-that the browser 
request was issued by browser:'202 and received by listener 210; 

r -Upon receiving the browser request, the listener 210 forwards the request to the web 
application server 280 in step 352. Specifically, listener 210 passes the request to the 
transport adapter 21 Z.using the proprietary programmingiinterface of tbelistener 210. The 
transport ad^ter 212 converts the request as necessary to pass the request to diqjatcher 214 
xisingta standard.dispatchCT'prograniming , / . i 

Dispatcher 214 id«itifies„flie request.object type that corresponds to the browser 
request in step -354 based orj thejW?tual path specified in the browser request by 
communicating with the^yirtual.path manager 250. The- dispatcher 214 determines in step 356 
if the request object type corresponds to an identifiable.cartridge. If the request object type 
does not correspond to an identifiable cartridge, the request is returned to the listener 210 in 
step 358 (see Figure 3B); .Ifiin-step_358 the listener 210 recognizes the request as a request for 
a static 'HTML, page, the li^ener accesses; the static HTML page, and sends the HTML page to 
the browser 202:in step 360. I^tfiejjrowser request is not recognized by the listener 210;-the 
reply is sent to the browser 202 in step 3 6.0 indicating that the request was unrecognizable. 

If-in step 356 the dispatcher 2-1 4 determines that (1) the: request must b? sent to a^^>. 
cartridge and (2) listener 210 has not be^n assigned any instances, of that cartridge that are^ 
currently FREE, then the dispatcher 214 com^ixmicates \yitli the. resoiirce manager 254 to^be 
-assigned an instance of the cartridge 230 to which the brojvser request can be Sent. In step : 
362, shown in Figure 3B, the resource maijager 254 determines whether an instance of the 
identified cartridge is available (unowned) among the existing number of instances.; For the 
purposes of explanation, it shall be assimied that the request-is associated with cartridge 230, 
and that cartridge 230 is a PL/SQL runtime cartridge. . 

If in step 362 the resource mai^ager identifies an available instance, for example ; : 
instance 260 of the PL/SQL;runtinie 230,. thei rpsoiirce,maniager:254 informs the dispatcher 
214 that the request should be sent to instance 260. The dispatcher 2 14 then-creates and sends 
a revised browser requestto the cartridge execution engiro 228 of the instance 260 in st^ 368 
to cause the available instance 260 to process the request, as described below. 

However, if in step 362 no instance of the cartridge 23;0-is available, the resource 
rnanager 254. determines ui step 364 if the existing nimber of ins^ exceeds a maximum 
prescribed number. If the^existing number of mstances;exceeds the ma 
number in step 364, the resoiHce manager 254 indicates to the dispatcher 214 that the request 
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cannot be processed at this-time.- In response, the dispatcher 214 retxims the request to the 
listener 210 in step 358, after which the web listener 210 sends a reply to the browser 202 over 
the network in step 360 indicating the request was not processed, - 

Alternatively, when a cartridge instance is not currently available to handle a request, 
listener 2 10 may place the request on a waiting list for that cartridge instance. When a 
cartridge instance becomes available, the revised browser request is removed from the waiting 
list and forwarded to the cartridge instance. If the revised browser request remains on the 
waiting list for more than a predetermined amount oftime/ listener 210 may remove the 
request from the waiting list and send a message to the browser 202 to indicate that the request 
could not be processed. ^ "T'. ^'-'y-y.^. 

If in step, 3 64 the: existing number of instances does not ' e^^ 
prescribed number^ the resource manager 254 initiates a tiew instance of the identified 
program and informs. the dispatcher 214 that a revised browser requisst based oh the browser 
request should be sent to. the new instance. The dispatcher 214 then dispatches a revised 
browsCTrequest to the. cartridge execution engine of the n^^^ — 

, For example,: assume that the resource man 
to ttie browser request. During the . initialization, :the stored sequences of instructions for the 
PL/SQL runtime are accessed to create anew instance 260 dffthe cartridge 230 in ah ^didress 
space that is separate from the.address space in which dispatcher 2 14- is executing. According 
to one embodiment, initialization is performed by loading the cartridge execution engine 228 
and having?the cartridge execution engine call the initiali2ation routine in cartridge 230. 
: ; _ Once the new instance 260:is rumiing, :the dispatcher 214 dispatches the request to the 
cartridge execution engine 228 associated with the new instance 260 ih step 368. The cartridge 
execution engine 228 sends a callback message to the new instaiice 260 requesting execution 
of the request. In the callback message, the cartridge execution engine 228 passes any 
: par^neters necessary for the instance 260 to process the request Such parameters may 
include, for example, passwords, database search keys, or any other argument fdt a dynamic 
operation executed by the instance 260. - - - - - ' ' " 

The instance 260 then executes the request During the execution of the request by the 
instance in step 368, the dispatcher 214 monitors the instance to deterinine the occurrence of a 
fault, in step,370. rflf in'step;370 the dispatcher- 214 detects a fatilt, the di^ktcher 214 calls the 
corresponding cartridge execution engine 228 in step 372 to abort die instance 260 having the 
fault. The corresponding cartridge execution engine 228 in turn issues a shut down command 
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across the API to the faulty instance. The instance, responcErig to the shut down command by 
the cardidge execution engine 228, wiU shut doA^^ 
other address space. ^ ; • 

r r If ill step 370 no feult is detected, the dispatcher 2 1 4 receive a i^ly from the instance 

5 260 upon completion of execution in step 374. The dispatch^ 214 in st^ 376 forwards the 
reply to. the^ listmer. 2.1 0^ which responds to &e browser with the reply from the executed 
instance 260. After executing the instanbe 260, the dispatchCT214 in step 378 maintains the 
instance in the memory, , a§,5hQwn . in step 37» to enable ex^titioh of a subsequerif reqiifest. 

10 DISTRIBUTED ARCHITECTURE OF WEB SERVER - 

^ Significantly:, the yarious components of the web applicaticm server 280 communicate ' 
with each other using:a commimicatibn mechanisnr that does not require the compohOTts to be 
executing in the same address space.or;even on the same machine. Iri the illustrated 
embodiment, the coinponentsrof the 'Web application- se ' ^ 

1 5 commimicate through^an Object:Request Broker (ORB) 282. Object Request Brokers aref 
.desCTibed in detail in "Cpipmon Object Request Broker: Architecture and Specification 
(CORBA); V :This and other documents relating to GORBA can be found on the' World Wide 
Web -at http://www;omg.org . ' i : / - - v > ^ . - \ X 

y.' . While the embpcBments^bf theipresent invention shall bedesscribed with reference'tb 
20 xpmmunicatipns through a CORBA-Compliant ORB, other cross^platform bonimunicatioh^ - 
mechanisms may: be used. For exainple, :the components of web ^^plication- server 280 may 
alternatively cominunicate with each ofeer using Remote Procedure Calls (RPG), a UNIX 
pipe, Microsoft X30M. ^ * . • : : . ;^ : 

.\ Because the yariqus components of the web qsplication server 280 cdnuriuiiicate with 
25 each other ijusing a machine mdependent communication mechanism, there ^e' lio inherent 
restrictions with respect to where the components are located with respcsct to each other. For 
.. exanaple, listeners 210, 216 ajidr222 may . be executing on the same machine^ or on three 
completely different machines, each with a different operating system! Similarly^ the 
^?*9Ptication server 252, vir^ path manager 250^ resource manager 254 and configuration 
30 provider 256 may be executing on the same machineorbn four different rnathines. Further, 
those, four, different machines may not haye ai^r overl^iwifKtfie three mathine^ executing 
Usteiiers 21.0, 216 aiid;222v. ^: c^- -t. ^ ^v^u: c':cr.— . • 
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, , . . Cartridge :execution engines 228, 232 and 236 incorporate all of the necessary logic to 
cominunicate with the other components, of the web application server 280 through the object 
request broker 282. Consequently, the location of the cartridge instances themselves is not 
inherently resticted by the communication niechanism. Thus, instance 260 may be executing 
5 in a completely different machine and operating system than dispatchers from which it 
receives requests. Likewise, instance 260 may be on a different machine and operating 
system than the resource manager 254 or any of the other components of the web application 
server 280, including instances of other cartridges that are being managed by the same web 
application server 280, 

10 Significantly, the location-independence enjoyed by cartridges used by web 

application server 280 is achieved through the cartridge execution engine communication 
logic, not through any custom programming in the cartridges themselves. Consequently, the 
cartridges do not need to be specially designed for execution in a distributed application server 
environment. Cartridge designers are thus insulated fix)m the complexities of a distributed 

15 system, and can concentrate their efforts on the logic associated with the tasks for which the 
cartridges were created. 

As described above, a web application server 280 that manages multiple instances of 
different cartridges to process a variety of user requests is provided. Each cartridge instance 
executes in a separate memory space from the listener, thus avoiding the security problems 

20 associated with server-side plug-ins. Further, the cartridge instances used to process the 

browser requests received by a listener may execute on entirely different machines than the 
hstener. Thus, the scalability of the system is increased, while the burden on any particular 
machine is reduced. 

In addition, web application server 280 also controls the number of instances for each 
25 given cartridge. Hence, server-side resources are controlled to ensure that a large nimiber of 
requests do not overwhelm any machine by an uncontrollable generation of instances. 

Further, execution throughput also is improved by maintaining a minimum number of 
instances ready for execution. Additional instances may be initiated and maintained in 
memory for executing subsequent requests, as opposed to terminating an instance after a 
30 single execution and then reloading the cartridge into memory in order to recreate an instance 
for execution of a subsequent request 

In the foregoing specification, the invention has been described with reference to 
specific embodinients thereof It will, however, be evident that various modifications and 
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^ changes may be made thereto \vithout departing frbm th'e broader spirit and scope of the 
invention. The specification and drawings are, accordingly, to be regaitied in an illustrative 
rather than a restricitive sense. • : . ^ . " . . 
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CLAIMS- •:: : ■ ' ■ - ' ^- ' \ ' ' 

What is claimed is: . v:^ ^ : 

1 . A method for executing an operation, the method comprising the steps of: 
executing a diispatcher on a first machine; 

executing a resoxirce inanagdr oh a second machine; 

sending a first message fiom the dispatcher to the resounie maiiager, where the first 
5 ^ message idmtifies a paulacularcartndge^^^ 

sending a second message from the resoxirce manager to tiie dispatcher, where the 
second message identifies a particular insta^^ 
, where the particiilar instance is execiitihg on a third machine; and 
sending a third message fi-om the dispatcher to the particuliar instance to cause the 
10 ■ -particular instance to execute the^ ^^6^ 

wherein at least two of the first mfiichine, the second machitie arid the third machine are 
' ^ separate machines; ^ ' ■ ' ' 

2. The method of Claini 1 ftuiher 

a browser sending a browser request to a web listener, 
15^ the web Ustener passing the browser request to the di^a^^ 

wherein the dispatcher sends the first message in response to receiving the browser 
request fi'om thei web HsteiiCT^ " 

3. The method of Claim 1 wherein: ' 

the firist machine and the second machine are sdparate^ 
20 the step of sending a first message &om the di^atcher to the resource manager is 

performed by sending the first message ffom the dispatch^ to the iresource 
' rdianager through an object request broker; and 
the step of sending a second message fix)m the resource managei: to the dispatcher is 
performed by sending the second message from the resource man^iger to the 
25 dispatcher through the object request broker. 

4. The method of Claim 1 whd-ein: - 

the second machine arid the third machine are separate machiiies; and 
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the method includes the step of the resource manager caxising the particular instance to 
begin execution on the third machine in response to the resource manager 

receiving the first message. 

* • ' ." * ' • • ' ' " , '. ^ . 

5. The method of Claim 1 wherein the resource manager determines which particular 

instance should perform the operation by performing the following, steps in response to 
, receti\ang the first message: , . , . ^ . , 

. ; determining whether any instance of the particular cartridge is currently executing and 
. imassigned; . , _ , - , 

, if any instance of theparticulsur cartridge is currently executing and xmassigned, then 
identifymg in sm(l,seQ^ an instance that is currently executing and 

, imassi^ed; , , . . . , . . ^ ^ - . . 

if no instance of the jppticidar. cartridge identified i%the first message is currently 
- , executing and imassigned, then initiating a new instance of .the particiilar J\ 
cartridge and identifying said new instance in said second .message. / 

). The method of Claim 5 wherein, prior to initiating the new instance, the r^ource ^: 
manager performs the steps of: . . . . , . ... 

inspecting m^Jadata.to determine a set of machines, including said third machine/lhat 

. aregipletpexeciitesaidpar^ 
selecting said third machine to execute said new instance of said particular cartridge. 

The method of Claim 1 fiirther comprising the-steps .of; . ^ - ■ 

causing said dispatcher to maintain a Hst of instances tiiat have been assigned to said 

dispatcher^, apd ^ _ . , ^ . . , . - 

in response to rpceiying said second message, causing said dispatcher to update said 

hst of instances to include, an entry for said particular instance. 

. ' ■ TTie method of Claiiii 7 wherein: ' " ' 

thie hst of iristances includes data indicating whe& 
currently busy; 

in response to sending said second message, the:dispatcher indicates in said entry for 

f said partipuiar instance that said particular^instance is, busy; , . 
the method further includes the step of the dispatcher receiving a fourth message fix)m 
said particular instance in response to said third message; and 
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. . in response to receiving said fourth message, the dispatcher updates said entry to 
: M indicate that saidiparticular instance in not currently busy. 

9. The method of Claim 8 further comprising the steps of: 

the dispatcher receiving a browser request that specifies .a second operation to be 
5 performed by a second cartridge; , 

the dispatcher inspecting said list of instances to deteraiine whether the list contains an 

entry for an instance of said second cartridge that is not currently busy ; 
if the list contains an entry for an instance of saiid second cartridge that is not currently 
busy, perfbraiing the steps of 2 - - 

10 r.^ the dispatcher sending a fifth message to said particular instance in response to 

1. ; ^ saidbrowsec request to' cause Said paiticu^ perform said 

second operation; arid ^ ^ * ^ 

updating said entry to indicate that said particular mstance is currently busy; 
if the list does not contain an entry for an instance of said secoiid cartridge that is not 
15 currently busy, sending a sixth message to said resource manager to cause said 

resource manager to indicate an instance of said second cartridge to perform 
said second operation. 

10. The.method of Claim 8 fiirther comprising the steps of: 

determining when said particular instance has beeii idle for more than a predetermined 
20 length of time; and ■ - ^ ' ^ 

when said particular instance has been idle for more than a predetermine length of 
time, said dispatcher releasing said particular instance to said resource 
manager. 

'11. A computer-readable medium carrying one or more sequences of instmctions for 
25 executing an operation, wherein ^execution of the one or more sequences of instructions 

by one or more processors causes the one or more processors to perform the steps of: 
executmg a dispatcher on a first machine; 
executing a resource manager on a second machine; 

sending a first message fi-om the dispatcher to the resource nianager, where the first 
30 message identifies a particular cartridge that is able to perform said operation; 
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sending a second message from the resource manager to: the dispatcher, where the 
second message identifies a particular instance of the particular cartridge, 
where the particular instance is executing on a third machine; and 

sending a third message from the dispatcher to the particiilar instance to cause the 
particular instance" to execute the operation; and 

wherein at least two of the first machine, the second machine and the third machine are 

' separate ihachmesr " " *^ 

'K . • • , * : -i- '; . ' , r- ' ! ^ ' • * . . 

The computer-readable ^lediiim 
instructions for perfomiing the steps of:: : ' 

a web . listener p3ssipg .a:bro3vs.er request received from a browser to the dispatcher, * 
wherein the dispatGher-^eijds the first message in response to receiving the browser 
request from the web listener, . r : . - - 

the computer-readable medixmi of Claim 1 1 wherein: ^ , 

the first machine and the second machine are separate machines; 
the step of sending a first message from ttie dispatcher to the resource manager is'; 
perfomied by sending the first message fix)m the dispatcher to the resource 
manager through an object request broker, and 
the step of sending a second messiage from the resource maniager to the dispatcher^ is 
performed by sending the- second message from the resource manager to thfe 
dispatcher through the object request broker. . • . 

The computer-readable medium of Claim 1 i wherein: 
the second machine and the third machine are separate machines; and 
the computer-readable mediiun includes the step of the resource manager causing the 
. particular instance to b^gin executipp, on the third machine m response, to the 
resoxirce manager receiving the first message. . ^ : 

The computer-readable mediima of Claim 1 1 wherein the resource manager determines 
which particular instance should perform the operation by performing the following 
steps in response to receiving the first message: 

determihmg whether any instance of the particular cartridge is currently executing and 

v"-^ -. . . c ::':;:.:: Vi 1 .*-:* :*:::: "^i::": 

unassigned; 
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if my instance of the particiQarcailrid^ 

, identifying in said second message an instance that is currently executing and 
unassigned;. ; 

if no instance of the particular cartridge identified in the first message is currently 
5 r : executirig md unassigned, then initiating a new ir^ 

r cartridge.^nd identifying said new instance in said second message. 

16. The computer-readable medium of Claim 15 wherein, prior to initiating the new 
instance, the resource manager perfoms tihe stq?s of: 

inspecting metadata to determine a set of machines, including said third machine, that 
10 are able to execute said particular cartridge; and 

selecting said third machine to execute said new instance of said particular cartridge. 

17. The computer-readable medium of Claim 1 1 further comprising instractions for 
performing the steps of: 

causing said dispatcher to maintain a list of iristances that have been assigned to said 
15 dispatcher; and 

in response to receiving said second message, causing said dispatcher to update said 
list of instances to include an entry for said particular instance. 

18. The computer-readable mediima of Claim 17 wherein: 

the list of instances includes data indicating whether the instances in said list are 
20 currently busy; 

in response to sending said s&cond message, the dispatcher indicates in said entry for 

said particular instance that said particular instance is busy; 
the computer-readable medium fiirther includes instructions to perform the step of the 
dispatcher receiving a fourth message from said particular instance in response 
25 to said third message; and 

in response to receiving said fourth message, the dispatcher updates said entry to 
indicate that said particular instance in not currently busy. 

19. The computer-readable medium of Claim 18 fiutherboniprising instructions for 
perfomiiiig the steps of: . " ' . . 

30 - the dispatcher febeivuig a browser request that specifies a second operation to be 

performed by a second cartridge; • ' - ' 
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the dispatcher inspecting said list of instances ta determine whether, the list contains an 
= ' entry for an instance of said second cartridge that is riot currently busy; 

if the list contains an entry for an instance of said second cartridge that is not currently 
busyj performing the steps of * v " ^ ' ' 

5 ^ r . the dispatcher sending a fifth message to said particular instance in response to 

^ ^ . i said browser-request to cause said particular instance to perform said 
second operation; and 
updating said entry to indicate that said particular instance is currently busy; 
if the list does not contain an entry for an instance of said second cartridge that is not 
10 currently busy, sending a sixth message to said resource manager to cause said 

resource manage to indicate an instance of said second cartridge to perform 
said second operation. 

20. The computer-readable medium of Claim 18 further comprising instructions for 
performing the steps of: 

1 5 determining when said particular instance has been idle for more than a predetermined 

length of time; and 

when said particulai* instance has been idle for more than a predetermine length of 
time, said dispatcher releasing said particular instance to said resoiuce 
manager. ... . ; ^ ' -/ . . : /i^: vr ■ C,:;..^ 

20 21 . A system for performing operations associated with browser requests, the system 
comprising: 

a plurality of dispatchers coupled to a plurality of web listeners^ wherein each 

(iispatcher of said plurality of dispatchers receives fram a corresponding web 
listener of said plurality of web listeners browser requests received by said 
25' cbrreq)ondinjg web listener; ' 

a resource manager coupled to said plurality of dispatchers through an inter-machine 
commxjmcation mechamsm that allows said resoiuce manager to communicate 
with said plurality of dispatchers without regard to the machines on which said 
plurality pf dispatchers reside,^said resource manager being configured tp 
3 0 assign to each dispatcher of said plurality of dispatch^ an instance of a 

... ..cartridge of said-plurality of cartridges in respo^e,to FeiQ5i\'ing a request for an 
instance fi-om said dispatcher, ^ ^ - , - . ^ - 
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said plurality of dispatchers being configured to send niessages througb «aid inter- 
machine communication mechanism to the instances that are assigned by said 

. . „ / resource manager to said dispatchers, said inter*machme communication 

mechanism allbwing said plurality of dispatchers to communiciate with' said 
instances without regard to the machines oh which said instances reside, said 
messages causihg said instances to perform the operations associated with said 
; \ browser request^. 

22. the system^f Claim 21 further comprising a viiti^ path, manager coupled tp.said 
pliiraUty of di^atchers through said inter-machine commimication mechanism, said 
virtual path manager indicating to said dispatches whicli of a pluraUty of cartridges is 
associated with said browser requests; \ 

23. The system of Claim 21 wherein said ihtet-inaehihe cbmfei^ an 
object request broker. ^ . . r , 

24. The system of Claim 21 wherem the resource manager is further configiured to initiate 
new instances of cartridges in respcjnse to messages from said dispatchers. 

25. the system of Claim 24 wherein, for eachiQartodge, said resource manager is 
configured to maintain a number of executing instances between a predetermined 
minimum and a predetermined maximimi. - 

26. The system bf Claim^ 21 wherein each^^atcher of said plurality of dispatchers is 
configured to maintain a Ust of uistances that have been assigned to said dispatcher by 
said respm-cernaiiager. - i . ^ 

27. The system of Claim 21 wfierein, if a digpatcher'of said plurahty of dispatchers 
receives a browser request assbciated with a particidar cartridge, and the list of 
instances maintained by that dispatcher^indicates that an instance of that particular 
cartridge is currently available, then the chspatcher sends a message to the instance 
without requesting ah instanc^ for the browsea: request from the resource manager. . > 
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A system, m^od, and computer readable-medium for perfonning operations associated with browser (202, 204. 206) requests are 
provided. The system iiicludes a plurality of diqjatchers-(214, 220, 226) coupled to a plurality of Wei) listener (21(), 216, 222). Each f the 
dispatchers (214. 220, 226) receives from a corresponding web listener (210, 216. 222) browser requests received by the corresponding web 
listener (210, 216. 222). The system further includes a virtual path manager (250) and a resource manager (254). The virtual path manager 
(250) is coupled to the dispatchers (214, 220. 226) through an intCT-machine communication (282) mechanism. The virtual path manager 
(250) indicates t the dispatchers (214, 220, 226) which of a cartridge (260) is associated with the browser requests. The resource manager 
(254) is coupled to the dispatchers (214, 220, 226) througij the inter-machine conununication {262) mechanism. The resource manager <254) 
is c nfigured to assign to each dispatcher (214, 220, 226) an instance of a cartridge f the cartridges (260) in r^ponse to receiving a request 
for an instance from the dispatcher <214, 220, 226). The dispatchers (214. 220, 226) are configured to send messages through the inter- 
machine communication (282) mechanism to the instances that are assigned by the resource manager <254) to the dispatchers <2I4, 220, 
226). The messages cause the instances to p^orm the perations associated with the 1}rowser requests. 
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A system, method, and computer readable-medium for performing operations associated with browser (202, 204. 206) rcqucste arc 
provided. The system includes a plurality of dispatchers (214, 220. 226) coupled to a plurality of web listener (210, 216. 222). Each of the 
dispatchers (214, 220, 226) receives fix>m a corresponding web listener (210. 216. 222) browser requests received by the corresponding web 
listener (210, 216, 222). The system further includes a virtual path manager (250) and a resource manager (254). The virtual path manager 
(250) is coupled to the dispatchers (214, 220, 226) through an inter-machine communication (282) medianism. The virttial path manago- 
(250) indicates to the dispatdicrs (214, 220. 226) which of a cartridge (260) is associated with the browser requests. The resource manager 
(254) is coupled to the dispatchers (214. 220, 226) through the inter-machine conununicati n (262) mechanism. The resource manago- (254) 
isconfigured to assign to cadi dispatcher (214. 220, 226) an instance facartridge f the cartridges (260) in response to receiving a request 
for an mstance from the dispatdiw (214, 220. 226). The dispatchers (214, 220. 226) are configured to send messages thn)ugh the inter- 
madiine communication (282) mechanism to the instances Aat arc assigned by the resource manager (254) to the dispatchers (214. 220. 
226). The messages cause the: instances to perform the operations associated with the browser requests. 
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AMENDED CLAIMS 
[received by the Intemational Bureau on 1 July 1999 (01 .07.99); 
original claims 1 and 1 1 amended; ranaining claims unchanged (3 pag^)] 

1. A method for ececutizig an operatioxL, th method compiising the stq)S o& 

executing a dispatcher on a first machine, whnein said dispatdier is an entity configured 
to receive requests fitsm clients and to distribute ^d requests to cartridges fliat 
are capable of executing said requests; 
5 executing a resource manage on a second machine; 

receiving a request at said dispatcher fiom a client executing on a machine that is 

diffemt fipom said first machine; 
in response to said dispatcher receivixig said request, sending a first message fitnn the 

dispatcher to the resource manager, where the first message identifies a particular 
1 0 cartridge type that is able to perform said operation; 

sending a second message firom the r^ource manager to the dispatcher, ^ere the second 
message identifies a particular instance of the particular cartridge, where the 
particular instance is executing on a third machine; and 
sending a third message firom the dispatcher to the pardcular instance to cause the 
IS particular instance to execute the operation; and 

wherein at least two of the first machine, the second machine and ihc third machine are 
separate machines. 

2r " The metfaod of Qaixn 1 fiirther conqvisi^ ' m^ - 

a browser sendixig a browser reqtiest a web liistenei^ 
20 : theweb listener passing the bniwser request to the dispatd^ : : ■ ^ v 

wherein the dispatcher sends the firstmessage in response to receiving the browser ' ' 
request fitmi the web listener, 

3. The medbd of Claim I wherism: 

the first machine and the second machine are separate madiines; 

25 the step of sending a first message fi:Qm the dispatcho: to the resource manager is 

, perfoniied by sending file first message fiom the dispatcher to Ae resour^ 

manager through an object request brokei; and 
v *^ ' ■ " ^ 

the stqp of sending a second message fix>m the resource manager to the dispatcher i^ 

performed by sendiiig die second message fiotn theiresoi^ ' 

30 dispatcher throtigh thi^i)bject tequest broker. , ; . . . 1. 

AMENDED SHEET (ARTICLE 19) 
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the meflipd further includes the step of the dispatcher receiving a fourth message from" 

■ sadd particular instance in response to sadd tidid m and 
in response to receiving said fourth message, the dispatcher updates said entry to indicate 
fhat^said particxilar instance in not currently busy, : , : 

5 9. The method of Claim 8 fur&er comprising tibe st^ of: 

the dispatch^- receiving a browser request that specifies a second operation to be 

performed by a second cartridge; 
the dispatcher inspecting said list of in^stances to dctennine whether the list contains an 
entry for an instance of said second cartridge titiat is not currently busy; 
10 if the list contains an entry for an instance of said second cartridge that is not currently 

busy, pcrfbrinijag the st^sx>f :r^ V :m ^ ; 

the dispatcher sending a fifth message to said particular instance in response to 
said browser requert to cause said particuiaj.im 
\^ secondoperation;:and.. . , ' '^ : 

15 updating said entry to indicate that said.partittiiar instance is currently busy; 

if the list does not contain an ^try for an instance of said second cartridge tiiat is not 
currently busy, sendiii^ a toi message to s^^ cause said 

resource manager to indicate an ir^tance ojF said s«::biid caitridge to perform said 
second q^^ation. 

20 10. The method of Claim 8 further conoprismg the steps of: ^ tI: g r 
determining when.said particular instance has been 1^^^ 
r- length of time; and'-;^ ^ -^^r: ■/•■^ t^xrv^'i;:' 

when said particular instance has been idle for more than a predetermine lengfli of time, 
said dispatcher releasing said particular instance to said resource manager. 

25 11. A computCT-readable medium canying one or more sequences of instructions &t 

executmg an opemtion. wherein execution of the one ormore sequences of instructions 
by one or more processors causes the one ormore processors to perform tiie stq>s of: 
executing a dispatcher on a first machine, whereiri said di^atcher is.an entity configured 
to recdve requests fix>m clients and to distribute said requests to cartridges that 

30 are enable of ©cecutmg said requests; 

executing a resource inane^er oh a secorid machine; 

receiving a request at said dispatcher froito a client executing on a machiiie that is 
dififerrat fixmi said first machine; 
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^ in response to said dispatcher receiving said request, sending a first message fiom the 

dispatcher? to thfe resoizrce manager, where the fibrst taesSage identifies a particular 
* * cartridge tjTf^e that itfabk - 
sending a second message ftorii the resource manager to the dispatcher, Where the second 
S message identifies a particular instance of the particular cartridge, where the 

particular instance is executing on a third no^^ 
sending a third message firom the dispatcher to the particuiar instance to cause the 

particular instance to execute the operation; and 
wherein at least two of the first machine, the second machjbe and the third machine are 
10 separate machmes. 



12. The computer-rcadaible medium of Qaim 11 fiirthercornprising instnictions 
. - fbrperfomingthe^stejft ofr ^^ r -> - k::: u . 

a web hstener passing a browser request received from a browser to the dispatcher, 
\^erein the dispatcher sends die first message in response to receiving the browser 
15 ^ ^ request- fix>3dtt the wdb fistehcK -7 - . / ' 

13. The computer-readable medium of Claim 1 1 i?^erein: 

the first machine anrf the gecnnH manhmft Are gqiaratft -nriarilniriftfi; 

the Step of sending a first message fiom the dispatcher to the resource manager is^ 
porformed by sCTdihg the first message firona ttre dispatcher to the resource 
20 manager through dnobJect'Teqiuest broker;:^ ' ' : 

t.xl the step of sending a second message' from the resource manager to the^ dispatcher is 
performed by sending the second message firom the resource manager to tibie 
jjji- : dispatcher tfarou^ the object request broker^.. 

14. lie computer-readable medium of Claim 1 1 wherein: 

25 the second machine and the third machine are separate machines; and . - ^ 

the conQ)Uter-readable medium includes the step of the resource manager Causing the 
1: particidar instance to begin:execudonbn the thinlmaxdunem^ 
" ' -'j-^ resource xxxanageT receiving/the first message, -l . 

15. The con^uter-readable medium of Claim 1 1 wherein the resource manager determines 
30 which particular instance should perfonn the opeiatioti by perfoiming die following steps 

in r^ponsc to receiving the first mess^e: . . 
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A system, method, and computer readable-medium for performing operations associated with browser {202, 204. 206) reauests aie 
XT^. '^fix**^ ' "'"^''y of dispatchers (214. 220. 226) coupled to a plurality of web listener (210. 216. 222) ^ of the 
d.spatch«s (214 220. M6) receives from a conesponding web listener (210. 216. 222) biows^ requests received b; the i^lSp^fw^ 
S*?!, «^,,;i!h J^%*^ " ^'"^ "^^'^ (250) and a resource manager (254). The virtual ^th mWer 

(250) IS coupled to the dispachers (214. 220, 226) through an intcr-machine communication (282) mechanism. TTie virtual path ^^er 
(250 md,cat« to the djspatchen* (214. 220. 226) which of a cartridge (260) is associated with the Lwser requests. Hie^S^ 
(254) « coupled to the dispatchers (214. 220. 226) through the inter-machine communication (262) mechanist The resom^ZLrSIS 
^configured to a^gn to each dispatcher (214. 220. 226) an mstance of acaitridge of the cartridges (260) in response to recei^^l leoues^ 
for an mstance from the dispatcher (214. 220. 226). The dispatchers (214, 220. 226) are confi|ui«» to senTiLa^^3f 
"^'f!f co'nmun'cat'on (282) mechanism to the instances that are assigned by the resource manager (254) to the dispatcher (214 220 
226). The messages cau» the instances to perform Reoperations associated with the browser requests. v . . 



BNSOOcie8«*a!5H8aVj!figifi?aate No. 29/2000. Section II) 



. FOR THE PURPOSES OF mFORMATldl^ ONLY 
Codes used to identify States party to the PCX on the front page^ of pamphlets>ub^^^ ihtematioruil applications under the PCX. 



AL 


Albania 


2S 


- Spun 


AM 


Annenia 


FI 


Finland 


AT 


Austria 


FR 


I^anoe -■^'-■^ 


AU 


Australia 


GA 


Gabon 


AZ 


Azettoijon 


GB 


United Kingdom 


BA 


- Bosnia and Henegovina 


GE 


Georgia 


BB 


Bart>ados 


GH 


Ohmia . 


BE 


Belgium' 


GN 


■ Guinea' 


BF 


Buikina Faso 


GR 


Greece 


BG 


Bulgaria . /• 


HU 


Hungaiy 


BJ 


Benin 


IE 


Ireland 


BR 


Brazil,.. . ' 


IL 


Israel . :, , . 


BY 


Belarus 


IS 


Iceland 


CA 




IT 


Italy ; , , 


CF 


Central African Republic 


SP 


Japan ' 


CG 


Congo 


KE 


Kenya 


CH 


Switzerland 


KG " 


^ Kyigyzstan 


a 


C6te d'lvoire 


KP 


Democrat People's 


CM 


Cameroon 




\ . \ Republic of Kore4 , 


CN 


China 


KR 


Republic of Korea 


CU 


Cuba . , - - - 




„ . "Kazakstan. - r ■ 


CZ 


Czech Republic 


LC * 


' Sami Uicia 


DE 


Germany , 


U 


, Uechteatstein 


DK 


Denmaifc : / ' - 




Sri Lanka' 


EE 


Estonia 


LR 


Ubena 



LS * Lesotho ' 

LT Lithuania 

LU Luxcmbouig 

LV Latvia 

•MC " Monapo ' ' 

MD Republic of Moldova 

MG^ .. . .. Madagascar , ^ 

MK"' The formef Yugoslav 

Republic of Macedonia 
ML ' Mali - ^ " 
MN Mongolia 
MR Mauritania! . ' . . ' • * 
MW Malawi 
MX- Mexico . . 
NE Niger ' 
NL . Netherlar^, . - 
NO -Norway * 
NZ New Zealand 
PL.- V - rt)land f ' ' ' 
PT Portugal 

Rofivania .-; 
RU Russian Federation 
,SD . :Sudan ,z - 
. SB," Sweden - , 

SG SmgqKire ^ ^ ^. 



SI 


Slovenia 


SK 


, Slovakia . , 


SN ■ 


Senegal 


sz 


Swaziland 


TD 


Oiad 


TG 


Togo 


TJ 


Tajikistan . 


™ 


T^nkmenistan 


TR 


Turkey 


TT 


TYinidad and Tobago 


UA 


Ukraine 


UG 


Uganda- 


US 


United States of America 


uz 


;U£beki^ : 


VN 


Vict Nam 




Yugoslavia- ^ 


zw 


Zimbad>we 



BNSDOCtD: <W0_9923784A3JB> 



wo 99/23784 



-1- 



PCT/US98/226S6 



DISTRIBUTED WEB APPUCATION SERVER 
FIELD OF THE INVENTION 

5 This invention relates to server architectures in networked computer systems, more 

specifically to a distributed architecture for enabling the dynamic servicing to user requKts 
across different machines. 

BACKGROUND OF THE INVENTION 

10 - 

The World Wide Web includes a network of servers on the Internet, each of which is 
associated with one or more HTML (Hypertext Markup Language) pages. The HTML pages 
associated with a server provide information and hypertext links to other documents on that 
and (usually) other server. Servers communicate with clients by using the Hypertext Transfer 
1 5 Protocol (HTTP). The servers listen for requests from clients for their HTML pages, and are 
therefore often referred to as "listeners". 

Users of the World Wide Web use a client program, referred to as a browser, to 
request, decode and display information from listeners. When the user of a browser selects a 
^ P^S?? browser that isLdisplaying the page. sends a request over the -^^ - 

20 Internet to the listener asspciated^with the Universfid Resource Locator (URL) specified in the 
link. In response tp ftp request, th^Jistener transmits the requested information to the browser 
that issued the request. The browser receives the information, presents the received 
information to the user, and awaits the next user request. 

Traditionally, the information stored on Ustenefs is in the form of static HTML pages. 
25 Static HTML pages are created and stored at the listener prior to a request fixjm a web 
browser. In response to a request, a static HTML page is merely read from storage and 
transmitted to tiie requesting browser. Cuirentiy, there is a trend to develop hsteners that 
respond-to browser requests by performing dynamic op^ations. For ;example, a listener: may 
respond to a request by issuing a query to a database, dynamically constructing a web page 
30 containing the results of the query, and transmitting the dynamically constmcted HTML page 
to the requesting browser. To perform dynamic operations, :flie fimctiOT of the listener 
must be enhanced or augmented. Various ^^roaches haVis developed for extending 
hsteners to support dynamic oi>erations. 
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One approach to providing dynamic operations in response to requests from web 
browsers uses the common gateway interface (CGI). CGI is a specification for transferring 
infonnation between a listener ^d a CGI program. A CGI program is any program designed 
to accept and return data that conforms to the CGr^ecification. The program could be written 
5 . in any programming language/includingC; Perl, or 

: : r ^ The CGI approach siiffers fi-om the disadv^tage that a separate process (a separate 
instance of the CGI program) is initiated each time fee specified request is received by the 
server.Turther, CGI programs execute on the same niac^ 

browser request. Consequently, receipt of a thou^aiid such requests from different users will 
1 0 cause a thousand processes to be initiated on the machine running the listener, exhausting 
available resources on the server. ^ 

A second disadvantage 6f the CGI approach ik that a 'separate process is initiated, 
executed and terminated for each request! thus, if a' fir^t set of ten requests are followed by a 
second set often requests, a first set of ten processed Will be initiated arid terminated for the 
15 first set of requests and a second set of ten {jroc^esises will be initiated arid terminated for the 
second set of requests. CGI does riot allow using the same ten processes that are used for the 
first ten requests to process the second ten requests to avoid overheaid associated with 
initiating iprocesses; " : . , ^ 

An alternative approach to providiiag dyriariiic resporises to requests involves using 
20 "plug-in" extensions. A plug-in extension intercepts messages sent to the server at various 
^stages to perform dpplicatibn-specific processing for i specific user request A server-side 
- plug^in execiites in the same-address space as thVUstener and all other server-side plug-ins. 
Hence, an application developer designing a plug-in must be familiar with the lower level 
operational details of the listener: Moreover, execution of the plug-ins in the same addre^^ 
25 space as the listener exposes the Ustener to Security and stability risks, where a faulty plug-m 
may cause otiier plug-ins or the Ustener itself to crash, or perform in an unpredictable manner. 

V A second problem with the plug-in appirbach is th^^ all 
plug-in operations are performed on the same machine that is executing the Ustener. Because 
the tasks performed by the plug-in extensions cannot be off-loaded to other machines, the 
30 scalability of the pliig-in approa^^ 
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SUMMARY OF Tra . ... 

- . ; -^"^^^oda^d system for handling browser requests, with a dis 

server is provided. TTie distributed environment aUows process 
5 perform the operations specified in the browser requests to. execute on different machines than 
the listeners that r:eceive the requeste.and the browsers that issue the requests. Because the 
cartridge instances zure pn different mach^ than the listeners, the listeners are better 
insulated against faulty cgrtridge instances, thus enhancing the reliabiUty .and security of the 
systeiiL . In addition, the scalability, of tilie system is greatly increased by spreading the 
1 0 processing burden of j?xecutijig the c^dge instances among many machines, rather than the 
same machine that is executing the listener. The ability to disfribute cartridge instance 
executipn across multiple m^hipes allows numjsrous types of load balancing techniques to be 
used in deciding when, md where to spawn new. car^ 

. According to one aspect of th? mvention, an operation is executed using a dispatcher 
1 5 that is executing on. a first machine and a resource manager that is executing on a second^ . 
machine. A first message is seiit from the dispatcher to.the resource manager. . The fijst'= 
inessage identifies a particular cartridge that is able to perform the operation. A second.vv^-- 
message is sent from the resource manager to the dispatcher. The second message identifies a 
.. .. P^9^|2rJnstance of Aepaiti on a tfiird 

20' machine. ....... ? 

A third rnessagefroni the diqjatcher is seiit to the particular, i^^ 
particular instance to execute the operation. At least two of the first machine, the second 
machine and the third machiiie are separate machines, , 

. . According to another aspect of the invention, a system for performing operations 
25 associated with browser requests is provided. The system includes apluraUty of dispatchers 
.'^o"??^ to .a plurality of web listeners. Each dispatcher of the, plurality.of dispatchers . . 
, . receives from a corresponding w^b listener of the plurality of web Usteners browser requests 
received by the corresponding web listener. 

, . . "I^® system fiorther iricludes a virtual path manager arid a resource manage The 
30 virtual path manager is coupled to the plurality of dispatchers through an intCT-machine 

communication mechanism. The virtual path manager indicates to the dispatchers whidi of a 
plurality of cartridges is associated with the browser requests. The resource manager is 
coupled to the plurality of dispatchers through the inter-machine communication mechanian. 
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The resource manager is coafigured to assign to each dispatcher of the plnrahty of dispatchers 
an instance of a cartridge of the plurality of cartridges in response to receiving a request for an 
instance from the dispatcher. . ^ ^ 

, The pluraiity .Qf dispatchers, are configured to send messages through the inter-machine 
5 . cpmmimcatipn mechanism to. the instances that are assigned by the resource manager to the 
di^atchers; , the instances to perform the operations' associated with the 

browser reque^its. . ;* . v \\.\-. vt;^ ; • ' ' • 

BRIEF DESCRIPTION OF THE DRAWINGS : ^ - v 

1 0 : ^ The present invention is illustrated by way of example, and not by way of limitation, in 
the figxires of the, accompanying drawings and in which U 
I similar elements and in which: / ^ i -- * : ^^^--'^ ^ ' 

Figure 1 is a block diagram of a computer systerh upon which an embodiment of the 
^ ^ invention maylbe implemented; ■ ' ^ ^ v ' ^ 

15 . Figure 2 is a block.di^ram of a distributed applicatioil^ server according to an 

embpdinient of the invention;^ - .^v: : : .: ' - - - 

Figure 3A is a portion of a flow chart illustrating steps for handling a browser request 
according to an embodiment of the invention; ' . ; - - 

Figure 3B is another portion'of the flow chart iilustrating' sieps for handling a browser 

20" request according to.an embodiment of the iiiventionn^^^^^ ^-^^^^^^ ' ' - 

; Figure 4 is a block , diagram of a table contaming iofoim 
dispatcher according to an embodiment of the invention; and 

. Figure 5 is a block diagram of a table cohtsdning iiiforraation maintained by a resource 
manager according to an embodiment of the inveht^^ 
25;: , ' ■ ^ . a > : - - ' ' ' " ' " 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT ^ = 

A method and ^jparatus for performing operations over a network is described: In the 
following description, for the purposes df explanatiori/nuhierdus specific details are set forth 
- in order to provide a thorbugh^understanding of the present invention. It will be apparerit, 
30 however, to one skilled in the art thatlhe preisent inventibn may be practiced without these 
specific details- In ofeej* iiistances, well-lmowri structures arid devices are shown in block 
diagram form in order td avoid unnecessarily obscuring t&t present- invention. 
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. - . . : : HARDWARE OVERVIEW ' • - : - 

: - . Figure 1 is a block diagram that illustrates a computer system 100 upbif which an 
embodiment of the invention may be implemented. Computer system 100 includes a bus 102 
or other communication mechanism for communicating information, and a processor 104 
coupled with bus, 102 for processing information. Computer system lOO'also-includes a main 
memory 1 06, such as a random .access memory (RAM) or other dynamic storage-device, 
coupled to bus 102 for storing information and instructions to be executfed= fey processor 104. 
Main memory 106 also may be used for storing temporary variables or other intermediate 
information during execution of instructions to be executed by processor 1^.~ Computer 
system 100 further includes_^a rfiad only memory (ROM) 108 or other static storage device 
coupled to bus 102 for storing static; irxforjnatipn and iiistructioiis for processor 104i A storage 
device 1 10, such as a magnetic disk or optical disk, is provided and coupled to bus 102 for 
storing informatipn and^iiistructipns, : .-^ - • v . 

Computer system 100 may be coupled via bus 102 to a display 1 12, such as a cathode 
ray tube.(CRT), for displayirig^nfcMonation to. a computer user.. An inputxievice 1 14, "4* 
including alphanumeric and other keys, is coupled to bus 102 forconmiunicating infonSation 
and command selections to prpcesspr 104. Anotheritype of user input device is cursor cbntrol 
1 16, such as a mouse, a trackball, or cursor direction keys for communicating directio'n"4f 
information and command selections ,to processor 104 and for controlling cunsof movenilsht on 
display 1 12. This input device typically has twp degreesof freedomin two axes, a^first^s - 
(e.g., x) and a second axis (e.g., y), that-allows,the device to specify positions in a plane. 

The invention is related to tiie use of co9iputeri system 1 00. to^^perform. specific 
operations in response to messages fiom browsers. According, to one embodiment of the 
invention, the operations are performed by computer system 100 in response to processor 104 
executing one or more sequences of one or more instructions contained in main memory 106; 
Such instructions may be read into main memory 106 from anbthCT computer-readable • - 
mediuna, such as storage device 110. Execution of the.sequOTces of instructions contained in 
map mempry 106 causes processor 104 to perform the process steps described herein. In 

embodimOTts^ hard-wired circuitry may betused in place of or iri combination with 
software instructions to implement the invention. Thus, embodimCTtsLof the invention are not 
limited to any specific cpmbinat^on of hardwaare circuitry; and software. . . j ^ . * 

The term "computer-readable medi 
participates in providing instructions to proc^sor 104 for execution. Such a medium may take 
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. many fpims,. including but not limited to, non-volatile media^ volatile media, and transmission 
media,.; Non-volatile media includes, for example, optical or magnetic disks, -3uch as storage 
device 1 10, Volatile media includes jdynamic memory, such as main memoiy 106." 
. Transmission media includes coaxial cables^ ^ 
5 . that comprise bus 1 02.; Transmission media can also take the form of acoustic or light waves, 
such as those generated during radio-wave and infi^-red data^ t^ 

Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other 
optical medixim, .punchcards,,papertape, any other physical medium with patterns of holes, a 
10 . RAM,'a PROM, and. EPROM, a FLASH-EPROM;: any other memory chip or cartridge, a 

carrier wave as described hereinafter, or any other medium firbin which a computer can read. 

Various forms of computer readable media^may be involved in carrying one or more 
sequences of one or more instructions to processor 104 for-executioh^ 
instnictions, may initially be carried on a magnetic disk 6 
15 computer can load the instnictions into its dynamic meirid^ and send the instructions over a 
telephone line using a modem. A modem local to computer system 100 can receive the data on 
the telephone line and use an infra-red trahsniitter to convert tiie data to an infra-red signal. An 
, infia-red detector coupled to bus 1 02 can receive the data carried in the infra-red signal and 
place the. data on bus 1 02. Bus^ L02 carries the data' to main memory 1 06, from which processor 
20 V 104 retrieves- and . executes, the instructibiis. The instructions' received by -miairi memory 106 may 
optionally be stored on storage device 110 either before of after execution by processor 104. 
; : Computer system lO0*also includes a^eommunic^on interface Ir8 coupled to bus 102. 
Communication interface 1 1 8 provides a two-way data cbmniuiucatioh coupling to a network 
link 120 that is connected to a local network 122. For example, communicatioh interface 118 
25 may he an integrated services digital networic (ISDN) caid or a modem to provide a data 
coimnunication connection to a corresponding type of telephone Une. As another example, 
:COmmimication interface 118 may be a local area network (LAN) card to pffx)vide a data 
. eornmunication connection to a3x>inpkible Wireless links may also be implemented. In 

any such ini^jlementiation, communication interface 11 8 sends and receives electrical, 
30 electromagnetic or:opticaI signals that carry digital data streams representing Various types of 
.information^, zr:^ :z ::: '^y..." ..rc:c^* vf"^.. : 

- Network, link 120 typicaUy ptovides data'^cbmmimica one or more 

- networks to. .other data devices. Fot • exSmpleV network ' link 120 may prbvidd a cormection 
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tlirough local network: -122: to: a host: computer :124 or to data equipment operated by an 
Internet Service Provider (ISP) 126. . ISP 126 :in^ turn provides data communication services 
through the world wide packet- data communication network now commonly referred to as the 
"Internet" 128. Local network 122 and- Internet 128 both use electrical, electromagnetic or 
5 optical sisals ^ that carry digital- data streams. /The signals through the various networks and 
the signatejpn . network link 120 and through communication interf^e' llS;.\VKich carry the 
digital^ data to and ; from coii^juter syistem 100, are exemplary - forms- of carrier waves 
transporting the information.. - . . • ■ - - . , : . 

Computer system 100 can sepd message and receive data, including pfogram'code, 
1 p through the network(s), netv^forkiink 120'and obnununicatiori interface 1 1 8.' In the Internet * ^ 

-example, a server 130 might tfansfnit:a requestedxode for an application ptogram through - 
... - Intemet 128, ISP 126, local .netvvNprk 122 arid communication interface 118:^. ' . , ^> 
, ; :The received code may be:executed by processor. 104 as it is rec'eived, and/or stored in II 
storage -deyice 110, or otherjnon-vdlatile.storage for later execution; In^this manner, computer M" % 
15 system 1 op may obtain applicatipn code in the form of a carrier wave.. e 



FUNCTIpNiU.. Q\^RYIEW:OF APPLICATION SERVER. # 
■ \ ' i FigW? Z is a block diagram pf a system 200 deagned according to an embodiment of x 
- ; . the invention- The system. 200 jnclud^sa plurality of browsers 202, 204 and 206 that . 
2.0 cojnm^icate widi-a plurality, of ^hgteners 210,'216.and 222 over the Intemet 208 according to ®5 
, - the-HTTP protocol, Inreisponse tp.requests from the browsers, the Usteners causey; web ^ ^ 

application sprver 280 to invoke software: modules, referred to herein as cartridges. In the 
illustrated embodiment, web application server 280 has initiated the execution of three 
. cartridges 230, 234 and 238.^ .. . > j,':- r.i v .i 

2^ : , The web^ application server .280 is composed' of numerous components, including - 
transport adapters 212, 218 and 224^ dispatchers 214, 220;and 226, an authentication server 
252, a virtual patii nianager 250^ ,a resource manager 254, a configuration provider 256 and a 
r plurality of cartridge execution engines 228, 232 and*236..The various components of the web 
application, seryer 280 shalLbe described hereafter in greater detail. . - 
30 Significantly, the numerous cpmponents of web applicattion server 280:communicate 

through an inter-machine conomunication mechanism, such as an Object Request Broker 282. 
, , Using m inter-machme Gommum 
, operations, specified ki bi:owser requegs-^^y peecute pndifGerentmachines than the listeners 
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that receive the requests aiid the browsers that issue the requests. Because the cartridge 
instances are on different machines than the Hsteners, the listeners are better insulated against 
faulty cartridge instances, thus enhancing the reliability and security of the system. In 
addition, the scadability of the system is greatly increased by spreading the processing burden 
5 - of executing the cartridge instances among many machines, rather than the same machine that 
is executing the listener. The ability to distribute cartridge instance execution a,cross multiple 
machines allows numerous types of load balancing techniques to be used in deciding when 
and where to spawn new cartridge instances. 

A typical operation within system 200 generally includes the following stages: 
10 A browser transmits a request over the Internet 208. 

A listener receives the request and passes it through a transport adapter to a dispatcher. 
The dispatcher commiihicates'with the virttiai path manager 250 to determine the 
appropriate cartridge to handle the request. 

At this point the dispatcher does one of two things. If the dispatcher knows about an 
1 5 unused instance for that cartridge, the dispatcher sends the request to that instance. If there 
are no imused cartridge instances for that cartridge, iflie dispatcher asks the resource manager 
254 to create a new cartridge instance. After the instance starts up successfully, the cartridge 
notifies the resource mmager Of its existence. The resource manager 254 then notifies 
dispatcher of the new instance. The dispatcher creates a revised request based on the browser 
20 request and sends the revised request to the new instance. 

" ' The cartridge instance handles the revised request and sends a response to the 
dispatcher. 

The dispatcher passes the response back throu^ the listener to the client. 
These stages shall be described in greater detail hereafter. 

25 ' 

" CARTODdES 
Cartridges are modules of code for performing specific application or system . , 
fimctions, A cartridge forms the basic irnit of distribution in the system 200. According to 
one embodiment of the invention, cartridges are named using Universal Resource Locators 
30 (LfRLs). Thus, a cartridge name has two parts: tiie IP address of the server on which t^ie 
cartridge res;ides,'ah3L *the in the server directory structure of the compiled _ 

cfflTtridgd code. Because cartridges are named using URLs, the cartridge name space is global 
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and cartridges may be accessed xising \hc same messaging techniques as are, used ta access 
other web resources, sudi as documents. ... 

According to one embodiment of the invention, each cartridge has a standard interface 
which'provides a common overall structure for all cartridges. The standard interface defines 
5 the intetfaceofroutines that are invoked by the web appUcationsqiyer 280 unde^ 

conditions. According to one embodiment of the invention, the abstract cartridge interface is 
as follows: 

interface Cartridge 

10 boolean initO; 

boolean authenticate(in Principal user_passwd); , 
boolean exec(in Request req_obj, out Response resp^obj); . . 
boolean sfiiitdownO; 

^ ^ "^^Q routine is responsible for intializing the cartridge instance. This may include 

ihvoldng the const^ctore of several subobjects, preforking th^ 
required shared resources. * " - 

The shutdownQ routine is responsible for cleaning up all of the resources and shutting 
down the cartridge instance. Once the shutdownQ routine is invoked on a cartridge instance, it 
20 inmediately becomes uikvailable fo^ 

The authenticateO routine validates whether the client requesting the services of the 
cartridge is authorized to use those services. 

The execQ routine is the generic way to dispatch all service requests to the cartridge. 

25 EXEMPLARY CARTRIDGES 

Each cartridge is either configured as a cartridge that performs a well-defined function, 
or as a programmable cartridge that acts as an interpreter or a routine environment for an 
application. An example of a programmable cartridge is a PL/SQL runtime, configured to 
* process database queries according to the Oracle-based Programming Language using 
30 ' Structured Query Language (PL/SQL).' The PL7SQL runtime executes a browser request 
having a database query. The PL/SQL runtime processes the request, for example, by .. 
accessing a datiabiase server in conmiunication with the cartridge instancye via a data:.link. 
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. Another example of a programmable 
JAVA runtime interpreter cartridge enables web application developers to write server-side 

JAVA applications to process browser requests. Similarly, a custom server may be configured 
as a cartridge in ord^ to provide dynamic operations such as, for example, accessing 
5 processes executed by a third party server. " ^ 

DISPATCHERS 

. Dispatchers are software modules configured to route the requests received by listeners 
to the appropriate cartridges. According to one embodiment of the invention, dispatchers are 
10 implemented as server-side program extensions (i.e.^ "pliig-iiis*0. As' such, the dispatchers are 
loaded into and execute within the same address space as the listeners to which they belong. 
The dispatchers may be linked with the listener code at comp or dyhariiically Ibiaded at 

runtime. 

In the illustrated embodiment, dispatchers 214, 220 and 226 are associated with 
1 5 listeners 210,216 and 222, respectively:: ^Dispatchers -2 14- 220 and 226 selectively route 
browser requests received by hsteners 210; 216 and 222 to c^tridges:" ^ 

For example, assxmie that listener 21 Dlreceives a browser request over the Internet 208 
delivered in the form of a Uniform Resource Locator (URL). ■ The browser request serves as 
an identifier for a web obj ect, for > example^ an HTML page' or an-bperation to be perfbnhed. 
20 The listener 210 hands off the browser request to dispatcher 214 without any' attempt at 
interpreting the browser reiquest. ■ Upon receiving'the browser request, the dispatcher 214: 

(1) conmixmicates with virtual path manager 250 to identify a cartridge selected by the 
browser request and to determine whether the cartridge required authentication, 

: (2) if the cartridge requires autheriticatioh, cohraiUnicat^^^ authentication 
25 server 252 to determine whether the browser is allowed to access the selected cartridge, 

(3) if access is. authorized, conmiuhicates with the resource manager to determine the 
specific instance of the selected cartridge to which the browser request should be sent, md 

(4) creates and dispatches a revised browser request for execution by the^^ecified 
instance of the cartridge.. •' . ^ ■ ' ■-■ - 

30 The revised browser request riepackages infonnation received in the original browser 

request. The revised browser request may include, for exarhple; a context object that contains 
data required for.the proper operation <)f the cartridge. * The <iata required for proper operation 
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, of,a cartridge may include, for exampleiia.transaction ID that identifies a transaction with 
, .>yhich the. browser request is associatei : ' - > - ' 

, cartridge replies to the request, the cartridge sends the reply to the dispatcher and 

the dispatcher passes the reply up to the-listener for transmission to the browser that initiated 
5 therequest. : - • ^..'.:-v^c 

CQNFIGURATION PROVIDER 
; ; Acpording to one gnbodirnept of the invention, cartridgeis that are to be used with web 

^ * . application server 280 are first registered with web application server 280. • During the 
10 registration .process, information about the cartridges is supplied to the configuration provider 
256. Configuration provider 256 stores the; information as metadata 258 for later access by 
, the. components pf the web. appUcati ^ 
The metadata 258 may include, for example, - 
(1.) -the carftidge name; .: . : / t \. ■ ' . t. 

15 ... (2). the ipnimum .„ r 

(3) the maximim nimiber of instances; _ ~ , . - , : 
: (4) the location oftlje code that implements .the cartridge; 4r 
. : V . : S^} ?he program-dependent funption jiames used by the cartridge execution engitfe to 
. e?cecute t^i^ callback fimctibns.(initializationi:request handier, shutdown); 
20 . ^ (6) aJist of machines for nroiiing the cartridge; * ■ : ^ . - 1 - 

- . :j ^V:^^ ^^l^ tme.for the, cartridge (the amoimt of time instances of the cartridge are 
dlowed to remain idle before they are shut down); , - * . , 

(8) an object identifier; and _ : 

(9) data indicating the iype of authentication service; if any, to be used with the 
25 cartridge. . 

- - The object identifier, specifies the data that must be suppHed by a browsd- request for 
requiting performance of an operation by the corresponding cartridge. The object type may 
be,a specific word, a URJL, or may include a virtual path such as /Vjava". 

Once the configuration provider 256 has stored the configuration information for a 
30 particular cartridge in the metadata 258, that cartridge is automatically.registered when web 
^ . appUcatipn server 280 is started... ^ . :v -"^n j w: .1 / ; : 

. . . . After a cartridge is xegistCTed ^sdfe^^^ 280; the resource * 

manager 254 initiates the minimum mstances for the cartridge. Once the minimum number of 
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instances has been initiated, the web application server 280 is prepared to process browser 
requests. 

THE VIRTUAL PATH MANAGER 
5 As mentioned above, dispatchers conimunicate with tiie virtual path manager 250 to 

determine where to route each revised browser request. Specifically, each browser request 
typically includes a URL. Upon receiving a browser requfcsi the dispatcher sends the URL in 
the request to tiie virtual path manager 250. The virtual path manager 250 responds by 
sending tiie dispatcher data that identifies the caorttidg^, if an^r, associated with the URL. 
10 In ordbr to supply the required infoimatioh to dispatchers,^^ 

consults the metadata 258 that maps URLs to cartriages.' In response to receiving a browser 
request, the virtual path manager 250 uses' th6 mapping' data to determine the cartridge, if any, 
to wMch the URL contained in the'browser requests correspbiids. ^ 

For Example, if the browser request is a URL re^iie'st beginning with the virtual path 
1 5 "/java-^the mapping may indicate that the JAVA iriterpretei: cartridge 'is configured to handle 
requests having the virtual path "/j ava'*. ■ ■ 

According to' one embodiment of th6 inVentioh, the virtual path manager 250 also 
determines whether tiie cartiidge associsited with the URL requires authmticition. If the 
cartridge requii^es authentication, tiie virtual patii manager256'iridicates in tiie response tiiat 
20 tiie virtual pafli manager 250 sends to the dispatcher tiiat authentication is required. If 

autiientication is not required, tiie dispatcher creates and sends a revised browser request to an 
instance of tiie cartridge witiiout invoking tiie autiientication server 252. If autiientication is 
' ' • required, the dispatcher sends tiie revised request to an instiaiiie of tiie cartridge only after tiie 
' autiientication server indicates tiiatthe revised request may be submitted to "an instance of tiie 
25 cartridge. • - 

r . . ■ THE RESOURCE MANAGER . 

The resoui^ce manager '254 of tiie' Web appUcatibn serv^ 280 manages tiie execution of 
each of tiie cartridges by initiating a predetermined minimuni number of instances for tiie 
30 cartridges, load balancing between tiie instances of each cartridge, and initiating liew instances 
" of cartridges as nec^saiy to^a-predetiBrii^ 
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For example, assimie that the metadata for a particular cartridge (Gl) mcludes the 
following information: ^ 
Name = CI 

Minimum Instances = 10 - 
5 Maximurn Instances = 50 . . . . 

Host Machines = Ml, M3, M8, .. . . . - - . ^ ■ - . 

Idle time = 30 seconds , - , - - - 

Based on this metadata, when partridge CI is first registered, resource manager 254 
10 will initiate ten instances. of CI. ; Resource manager.254 will-initiate the ten instances on the 
machines associated \\ath the labe^^ . . 

. Upon receipt of requests jp-ojn dispatchers to access CI, resource manager 254 
determines whether any existing instmce of C 1 is available for use. If no instance of C 1 is 
available when a request is received, resource manager, 254 determines whether theimaximum 
15 number of instances of CI are already running. If the maximxmmumberof instances of CI 
are not aheady running, then resource manager 254 initiates a new instance of CI on one of 
the possible host machines and transmits a njessage^that identifies the new instance to the 
dispatcher that issued the request. If the ijriaximum number of instances pf C 1 are already 
running, then resource manager 254 sends a message to the dispatcher that issued the request 
20 to inchcate that thexeque^^^^ „ ^ ^ , „ ■ . 

, LOAD BALANCING . . . ^ 

According to one embodiment of the invention, resource manager 254 applies a set of 
load balancing rules to detennine where to initiate instances of cartridges where there is more 
25 than one possible host machine. Thus, in the above example. Ml, M2 and M3 are all capable 
of executing instances of cartridge CI . If Ml, M2 and M3 have the same processing capacity, 
it may be desirable to distribute the instances evenly across the three machines. However, if 
Ml has ten tinaes the processing power of M2 and M3, it may be desirable to initiate all 
instances of CI on Ml up to a certain point, and then to distribute additional instances evenly 

30 among Ml, M2 and M3. . . ^ _ . . , 

^9 .^sist resource manager 254 in detennining how to. Ipad balance among possible 
machines, the metadata stored for each cartridge may include additional details. For example, 
the metadata may -specify a separate nmiimum and maximimi number of instances for each 
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machine.;. Resourpe manager 254 may then distribute new instances among the machines 
based on which machine has the lowest ratio of actual instianceis to maximum iiistances. 

The metadata may also specify an order-for the machines that can run a cartridge. The 
xnachine at the N+1 position in the orderis only used to execute instances of the cartridge 
when the machine at the Nth position in the order is already executing its maximum number 
of insftances. ^ . l ^ . . ^ . 

CARTRIDGE INSTANCE STATUS TiLACKING 
According to one embodiriient of the ixivenfiori, the re^soiirce manager 254 maintains 
state information to keep track of cartridge instances that have been created. The state 
information includes; data that identifies the instance^ identifies'^ the machine executing the 
instance, and identifies the list enei- to which the instance has been assigned. 

Figure 5 illustrates a table 500 thatmiay be maintained By tesoiifce'^ 254 to 
store this state, information. Table 500 iricludes an Insfance column 502; a cartridge column 
504, a listener column 506 and a machine coltram 508: Each row of table 500 corresponds to 
a distinct cartridge instance. Within the row for a given cartridge instance, cartridge column 
504 identifies the cartridge associated with the cartridge inst^ce and m^ 
indiciates the mstance number of the cartridge instance: For example, row 5 10 cdrr-espohds to 
an instance of cartridge. CI.. Therefore^ ciartridge coliiiim 50^^^ of ro^'SilO indicates caiSndge 
CI. Instance column 502 of row 510 indicates that the cartridge iiistance^a^^ row 
510 is instance 1 of cartridge CI. - ^ 

.Listener column 506 in^cates the listened to which the cartridge instance associated 
with a row has been assigned. Machine colimin 508 indicates the machine on which the 
cartridge instance associated with a row is executing. For example, the cartridge instance 
associated with row 510'has been assigned to Usterid: 210 and is executing on machine Ml. 

Similar to resource manager 254^ each dispatcher maintains state infofmatiori for the 
cartridge instances that have been assi^ed to the Usteher to which the dispatcher is attached. 
Such state information may be maintained, for exaiftple, in a table 400 as shown in Figure 4. 
Similar to table 500^Ltable 400 includes ah ihsfimce dolumn 402 and a cartridge column 404 
that respectively: hold instance numbers aiid cartridge idratifiOT.' Hbweyer, wlu^ table 500 
includes„one entry for every cartridge instance assi^ed by resource mana:ger 254, table 400- 
only includes entries for cartridge ihstMees tiiat have been assigned to a partic\iliaf listener. 
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'. example, table 400 includes entries for only those cartridge instsiriees liked in table 500 
Uiat have been assigned to listener 210., . • . .•. - . 

. . . In addition to instance column 402 and cartridge column 404, table 400 includes a 
status column 406. For each row, the status column 406 holds a value ihat indicates the status 
of the instance associated with the row.j For example, the st^ column "Wof row 408 
indicates that instance 1 of cartridge CI is currently busy. In the illustrated 'embodiment, the 
status column 406 holds a flag that indicates that a cartridge mstance is either BUSY or FREE. 
The significance. o/:the cartridge status Shall ridw.be describeiwith reference to Ae operation 
■ of resource managCT 254 and dispatchers '2 14 and 220; ■ ' - - 

. - n^HEI^GTION BETWEEN DISPATCHERS AND"^ ^^-^^^ 
, . : - THERESOURCE MANAGER ' - ' " 

: a^PVe,,dispat(5hers communicate with resource jnanager 254 when they 

. need to send a revised browser request to a particular cartridge. According to one - 
embodiment ofthe invention, dispatchers .first determine whether aninstari&e of ±^ 
appropriate cartridge (1) has ateady -beeri assigned to it and (2) is available to process the new 
revised brows^. request If au^propriate cartridge instance has ah-eady been assi^^^d to the 
. , dispatcher and, is currently available to process. the new revised browser request, fligft the 
: : rf^^^*^^? fopvards the revised browser ^quest to. the cardidge^instance: without fdxther 
. CO.iiWi^^i^ucatipn w[ith resource-manager 254; ; ;• -r. : 1. . . . ' 

For example, assimie that listener 210 receives a. bixjwser request that, according to 
virtual path manager 250, mustbe processed by cartridge Ci; ■ Assumie also that table 400 
reflecte the current list and status of cartridge instances that have been assigned to listeria- 
21 0. Upon receiving the browser, request fiomjistener 21 Oi dispatcher 2i4 inspects table 400 
to locate a FREE instance of cartridge Gl. In the illustrated: table 400,.row..410 iiidicatesthat 
instance 3 .of cartridge CI is currently FREE. . .Consequently, dispatcher 214 forwards a 
revised browser request directly to instance 3 of cartridge CI without. finther communication 
with respijrce rpanager 254. Iii response to sending the revised browser request, dispatcher 
214 changes the status value in status column 406 of row 410 to BUSY. 

If a list^per has^ not already bera asdgned an .appropriate^^^ 
currratly ava^lab.le^^en the dispatohCT.associated,'With thercartridge lequests a cartridge 
inst^ce fix)rn the r^urce manager 2?4.^ If-feeiresgiEcce manager 2S4'iietermines tiiat 'an 
instance ofthe required cartridge is not available and the number of existing instances of &e 
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required cartridge is below, the maximum, then the resource manager 254 initiates a new 
cartridge. Upon initiating.a, new cartridge, the resource manager 254 inserts an entry for the 
new cartridge instance in table 5jOO., . .. . - • 

Assume, for example, that listener 210 receives, a browser request that must bfe 
processed by cartridge. C3. Assume also ftat instance 3^f .cartridge C3 has not yet been 
initiated. Under these conditions, . dispatcher 214 sends to resource manager 254 a request for a 
handle to an instance of cartridge C3. - In response to this request, resource manager 254 
initiates instance 3 of c^dge C3 on machine M3. In additiQn,:resource manager 254 inserts 
into table 500 the entry foimd at row 512. i.r v.; : : 

After inserting row 51.2Jor instance 3 of carteidge C3 in table 500; resource manager 
254 sends back to the dispatcher 214 a handle to the newly created instance; In response to 
receiving this.handle, disp.atcher 21.4, inserts an entry (rpvv 412) for the new instance in its 
status table 400. The dispatcher 214 then ti^smits a revised browserrequest to instanced of 
cartridge C3.. _ ., . .-.t: . . ■ ■ - ■■• 

RELEASnSFG CARTTOGE; INSTANCES ; 

According to pne embodiment of the inyentipiii Usteners do not. automatically release 
o\ynership of cartridge instances when the carfaridge instances finish responding to outstanding 
browsCT requests. For example, assungetiiat mstmce 3 -Qf ca^ 
browser request, processes the revis^ed browser request, and sends a response back to - 
dispatcher 214. Dispatcher 214 passes the resppnse to listener 210 to be sent back to the 
browser that issued the browser request. . . y ' ^ ^ 

-At this.point, listener 21 0 no tonger requires ownership of instance 3 of cartridge C3 . 
However, rather than transferring ownership of instance 3 of cartridge C3 back to resource 
manager 254, dispatcher 214 merely changes the status cclumn 406 of row 412 from BUSY to 

FREE,. • . ^ ■ ■ -■: ' ■' - ■ 

Changing.the value ill status column 40frof row 412 to FREE indicates that instance 3 
of c^dge C3 is no longer working on a request, and is therefore ready to handle subsequent 
requests. However, because table 400, which indicates that instance 3 of cartridge C3 is 
available, is mamtamed locally by dispalcha: 214, instance 3 of cartridge C3 is only available 
for subsequent browser requests.OTiymg at li?^^ Row 512 of table 500 mamtained by 

resoiffce m.anager,2;54.continues tomdi^ of cartridge C3 is owiied by 

hstener 210. 
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. ■-= . Because Usteners do not automatically release cartridge instaiides ^efy time a request 
. :is serviced, overhead associated with comniumcation between the resource mii^ef 254 and 
the various dispatchers is significantly reduced. For example, assuine that a listener 210 
receives ten successive requests that inust be communicated to cartridge' C3; Rather than 
5 . communicating with resource manager 254 for each of the ten rfequests, 'dispatcher 214 may 
. communicate, with resource manager 254 in "response to the first r^ijuest. The subsequent nine 
requests can be handled by dispatcher 214 Without communicating ^th resource miiager 254 
befcause the dispatcher2i4:uses=the^same instance of C3 that processes fee fi^f request to 
process the nine subsequent requests. 

While not automatically reieasing listener ownership of cartridge instances when each 
request is serviced canincrease the efficiendy of web application server 280, listeners cannot 
maintain ownership of cartridge instances indefinitely. Fbf exaiiiple. instances thai have not 
been used for long perioiis of time should be passed back tb the resource manager 254 so they 
can be de-allocated to free up resources. In addition, it is not efficient for one listener to 
maintain ownership of the instance of a cartridge that it has not used for a relatively long time 
when other listeners require mistances' of that cartridge. - 

■ , Consequently, resource manager 254 coinmiinicates to each listener a liiaximum l^le 
time for each cartridge ihstance passed to -the'listenSr'. Tlie maximuni idle time ihdicatesSe 
c -maximum amount of time a cartridge instance can go^u^^ before the listeiier inu^t release 
ownership-of the cartridge ihstance. For fexamjjle, asstmie that the resource manager 25^^^^^ 
indicates to. listener 210 that^the miaximum amount of idle time foi- instance 3 of cartfdge C3 
is 1 0 minutes. Based on this information, listener 2 10 may continue to use instance 3 of 
cartridge C3 to process brbwser requests for carttidge C3 as ioJig as mstance 3 bf cartridge C3 
does not remain idle or FREE for more than 10 minutes. . . !. 

. If instance 3 of cartridge C3 is idle for more than 10 minutes, dispatcher 2 1 4 removes 
row 412 fi^m table 400 and sends a message to resource manager 254 that listener iiff is 
releasing <iwnership of instance 3 of cartridge C3. hi i^ohse to this messagfc, resource 
manager 254 updates row 512 to indicate that mstance' 3 of cartridge C3 is not^oWned by any 
listener and may thus be reassigned to anbther listener or terminated. - ' . 

In an alternative embodiment, dispatchers do not automatically release cartridge 
instances when the.idl&time for the-biartridge instance h^ sxpa^^liisi^ the dispatcher 
sendsA message to resource manager 254 ofFCTiig to release =flie e3qj'ired mstanW. R^biirce 
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manage 254 may. respond to the' offer by requesting that the' listener release the cartridge 
instance, or by allowing the listener to retain ownership of tiie expired cartridge instance. 

According to one embodiment of the invention, reSoiifce manager 254 inaintains a 
queue .of the requests that cannot be immediately serviced. Whedi it becomes possible to 
5 service a queued request the risquest is rraioved from Ihe queue and processed. 

For example, assume that Uistener 222^ receives a browsfer request that inuist be 
processed by cartridge CI, and thiat listener 222 has not been asTsighed any instances of 
cartridge CI . Dispatcher 226 sends a request for aii instance bf'Cl to resource manager 254. 
Assume further that a mkximum of 50 instances of CI ^e allowed, and that 50 instances of 
1 0 CI have been assigned to listeiier 21 0. "Under the^e" cotiditidiiis; resdiirce'managCT 254 cannot 
. service the request^ ftjom listener 222v Therefore, resource mahagbr 254 puts the request on a 
queue. When listener 210.releases 'an instanfce of C I ; resource itfafaager '254 coiimiunicate to 
Ustener222 that an instance of G l is available: ^ - - 

Under^certaih conditions, resource manager 254 may preemptively cause a listener to 
1 5 release a cartridge instance. ^ For exaihple, resource manaiger 254 may detect a system 

overload situation and respond by teiminatiiig a set of cartridge instances, either before or 
after informing the listeners that cmxeritly have been assigned the cartridge instances that the 
cartridge instances are going to-be terminated: * 

Resource mainager 254 may also preemptiveily catise listeners to release cartridge 
20 instances to implement fairness policies between listeners^^^ For "example, resource" nianager 
254 may cause a listener that holds the most instances of a given cartiridge to release ah 
instance of the cartridge when another listener has waited more than a predef ermifted 
threshold of amount of time for an instimce of the cartridge. For exampile, if listener 210 has 
been assigned 50 instances of cartridge CI and CI has a maximum of 50 instances, then 
25 resource manager 254 may cause listener 210 to release an instance of CI ten seconds after 
receiving a request for an instance of CI from another iistenet. 

- CARTRIDGE EXECXmONENGI^ 
■ According to one embodiment of the invention, ^ach cartridge instance is composed of 
30 a cartridge executioh engine afid a cartridge!! A carbidge execution engine is a code module 
that insulates cartridges frbna the coniplexitieis of the web aipplicatidn server 280 "and the inter- 
module conmitmication mecHam^^^ is made available to a cartridge execution 
engine by storing in a function table pointers to the cartridge functions. According to one 
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embodiment, all cartridges, provide the functions specified in the exemplary cartridge interface 
described above. By having all cartridges support the same interface, a single standard 
cartridge execution engine can be used with all cartridgj^. ; : , - 

According to one . embodiment of the invention, cartridges are implemented as shared 
5 libraries,, and cartridge execution engines are executable programs that invoke the routines in 
the shared libraries usiiig_.the standard cartridge interface. The cartridge execution engine 
provides the interface l?ptween cartridges and. the dispatcher, directs cartridge flow of control, 
^ and provides sen/ices for cartridges to i;se. ; - ; , 

When the resou|r<c.e xnan^ger 254 requires the creation of a new- cartridge instance, the 
10 resource manager 254 causes a cartridge execution erigine to be instantiated.^ In turn, the - ' 
instaiice of the cartridge e?cecutipaetigine thus created caiuses the appropriate cartridge to be 
instantiated. The respiirce manager 254. can^ cause the.cartridge execution engine to be- l 
instantiated, for example, by invoking a "cartridge execution engine factory" that resideslbn 
the machine on which the cartridge isjo be.executed.. -The iiistance of ihe. cartridge executionr^ 
1 5 engine can cause the caitridge^tp, bQinst^^itiated, for example, by making, a call to one of the^ r: 
routines in the shared library flx^t cqnstitutes^.^t^^ . ^ . . ^ . ^t^* 

As shown in Figure 2, ,the web application server 280 incliixdes cartridge, execution 
engines 228, 232 and 236 for each of the cartridges 230, 234 and 238. The cartridge - - 

execution engines control, executipi^ pf tiie instances of the corresponding .cartridges by . 
making calls iiito the cartridges through the standard cartridge interfacer By: establishing -b 
callback functions between the^cartridge execution engine arid a cartridge, ,any cartridge, can 
be integrated into the web application server 280 by cqnfigxrring ttie eartridge tp.respond to the 
callback functions, and then registering the cartridge in the configi^ation provider 256, as 
described below. . _ , , . - - \ r ^ ^ i 

. Thus, if the dispatcher 2 14 determines that the PL/SQL yTuntiine cartridge is.the 
appropriate cartridge to process a request,. the dispatcher 214 dispatches the request to a 
cartridge instance that includes a cartridge execution engine associated with the PL/SQL 
runtime cartridge. If a new instance needs to be initi^ed, the resource manager 254 <Teates a 
. new instance of the PL/SQL runtime cartridge in a separate address -space and dispatches the 
30 request to the cartridge execution engine 228 of the new instance. The^diess space used to 
execute the instance of the progrpri may be within memory of the cpmjHitcr system upon . 
which one or more of the comppni?nts of yfch applicfation server 280 is^xecuting, or oh. : 
anofeer computer systeqa.^ - ^ . . . 
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, In response to a message from a dispatcher, the cartridge execution engine issues a 
request handler callbaek iunction to the cartridge, causing the cartridge to process the request. 
The cartridge executing the request returns the result to the cartridge execution engine, which 
forwards the resiilt to the dispatcher. In the event that the web application server 280 detects a 
5 fault in the operation;- the cartridge execution mjgihe issues a shutdown function of the 
; ^cartridge.':: • i""^' '--^ " 

Hence, the cartridge execution ehginfe provides an i^licatioh programming interface 
to the web application server 280 that specifies predeterimhbd dperatidns to be performed. 
Use of the standard cartridge intbrface enables programmers of the cartridges to configure 
10 each cartridge for liigh-level integration into the web application server 280 indepeildent of 
the protocols used by the particular' web listener with wtiich the cartridge will be used. 

' ' TRANSPORT ' 

Listeners enable the use of server-side pliig-ins^^^^ 
15 and protocol for use by- such plug-ins. Unfortunately, the programniing interfaces and 

protocols provided by listmers' vary- from listener tb listener. For example, Netscape Server 
Application Programming Interface (NS API), Interiiet Server Application Programming 
Interface (IS API) and Application Development Interface (ADI) are three examples cif distinct 
programniing interfaces cun^ently provided by listeriers.^i ' ' ' 
20 : Transport adapters insulate dispatchers from the proprietaiy protocols aiid int'eifaces 

-used by web listeners: Specifically, each trsmsport adapter is configured to recoghize the 
protocols of different listeniers, arid to convert the browser requests received fit)m the listeners 
. into converted browser reqixests having a standard dispatcher protocol that is indq)endent 
from the protocol of the listener. Similarly, transport adapters convert the replies from the 
25 dispatcher to the transport protocol of the listeners. 

Hence, the transport adapter enables the web applica^on server 280 to be used with 
listeners from different vendors. Moreover, transport adapters may ft e configured to 
acconmiodate different servCT architects 

30 OPEKATION OF THE WEB AP^^ 

Figures 3 A iarid SB ai^ a flow7diagram illustoting a Aethod of responding to a browser 
request according to an dmbbdiriierit of the present Wention."T^ browser recijuest is received 



BNSDOaO: <WO_9923784A3JB> - 



•,:-ssW:^^^ PGT/US98/22d56 

• -21- 



^ • "i. stqj- 350 by a listener. For the^ purposes of explanation, it shall be. assumed that the browser 
. ^ requqgt^was issued.by browspr 202 and received by listener 210. : • J - — - 

^ , Upon receiving the browser request, the listener 2 10 forwards the request to the web 
application server 280 in step 352. Specifically, listener 2 10. passes the request to the ^ 
5 transport adapter 212 using the proprietary programming. interfece of.the li^ener 210. The 
transport adapter 212 converts the request as necessary to pass the request to dispatcher 214 
. using a standard dispatcher prograinnaing :^ — i: ^ 

; Dispatcher 214, identifieScthe requestobject type that corresponds to the browser 
K . request in step 354 based on Ae virtual path, specified in the browser request by . . 
10 copimunicating with the virtual path manager 250, The dispatcher 214 determines 'in step 356 
if the request object tygp corresponds to ap identifiable cartridge. If the request object type 
does not correspond to an identifiable cartridge, the request is returned to the listener 210 in 
step 358 (see Figure 3B);: If instep 358 the listener 210 recognizes the request as a request for 
a static HTML page, the Hstener accesses the static HTML page, , and^sends the. PTTME^page to 
1 5 the browser 202 in.step,360. . If the.bro\yser request is not recognized by the listener 210, the 
reply is j^ent tojhe bro^yser 202 in step 360 indicating that the request was unrecognizable. 
; , If in st^ 356 th^ dispatcher 214 determines that ( 1) the request must be sent toia ' 
cartridge and (2) listener 210 has not been assigned any instances of that cartridge that%e 
currently FREE, then the dispatcher 214 communicates with the. resource manager 254^;to be 
20 ; ^as^signQd an instanc^.of the cartridge 230 to which the browser reqyest-ican be, sent. In^step . / 
362,. shown in Figur&3B, the. resource. manager 254 deteraiines whether an.instance of,the 
identified cartridge is available (unowned) .among the existing number of instances.; For the 
. purposes of explanation, it shalLbc: assumed that the request is associated^with cartridge 230, 
and tiiat cartridge .230. is a PLySQLriflitimecartridge^^ , ^ ^ 
25 If in step 362 the resource manager identifies an available instance, for example 

instance 260 of the PL/SQL runtime 230, the resource manager 254 informs .the dispatcher 
214 . that the request should be sent to instance 260. The dispatcher 214 then creates arid sends 
a revised browser request to t^e cartridge execution engine 228 of the instance 2^0 in step 368 
to cause the available instance 260 to process the request, as described below. 
30 However^ if in step 362 no instance of the cartridge 230 is ayailable, the resource 

. „ . manager 254 determines in step 364 if the existing number .of instances exceeds a maximum 
^ , . prescribed nxmiber. If the existing piupaber of instances exceeds fee^maodmum prracribed 

number in step 364, the resource manager 254 indicates to the dispatcher 214 that the request 



BNSDOaD: <WO_©9237B4A3JB> 



wo 99/23784 ''^^^¥i^/iJS9m26S6 

-22- 

caiinpt be processed at this time. In response^the dispatcher 214 returns the request to the 
listener 21Q in step 358, after which the web hstener 210 sends a reply to the birowser 202 over 
the network in step 360 indicating the request was not processed. 
; - Alternatively, when a cartridge instance is not currently available to handle a request, 

5: listener 210 may place the request on a waiting list Tor that cartridge instance. When a 

cartridge instance becomes available> *the revised browser request is removed from the waiting 
list and forwarded to-the cartridge instance. If the revised browser request remains on the 
waiting list for more than a predetermined amduht of time/'listener 210 may remove the 
request from the waiting list and send a message to the browser 202 to indicate that the request 

10 could not be processed. . ' - - . : * " ' ^ ' - - 

' : ^■■i" ^ If in step 364 the . existing nuiriber of instances does not 'exceed the maximimi 
- prescribed number, the resource manager 254 initiates' k hew instabce of ttie 'identified 
program and informs the dispatcher 214 that a revised^browser request based on the browser 
request should be sent to the new instance. The dispatcher 214 then dispatches a revised 

1 5 browser request to the cartridge execution engine of the new instance.^ 

For example, assume that the resource manager 254 initiated instance 260 in response 
to the browser request. During the initialization, the stored sequences of instructions for the 
PL/SQL runtime are accessed to create a new instance 260 of the cartridge 230 in ah address 
space that is separate 'from the address space in which dispatcher 214is executing. According 

20 to one embodiment, initialization is performed by loading the cartridge execution engine 228 
and having the cartridge execution engiiie call the irntialization foutine'in cartridge 230. 

; Once the new instance 260 is nmnihg, &e dispatchCT^ 
cartridge execution engine 228 associated with the new instance 260 iti step 368. The cartridge 
, execution engine 228 sends a callback message to the new instance 260 requesting execution 

25 of the request In the callback message, the catrtridge execution engine 228 passes any 
parameters necessary for the instance 260 to process the request. Such parameters niay 
include, for example, passwords; database search keys, or any other argument for a dynamic 
operation executed by the instances 260. 

. The instahce 260 then executes theTequbst. During the execution of the request by the 

30 instance in stq> 368; &e dispatcher 214 monitors the instance to deteraiine the occurrence of a 
. fault in step 370. "If iii step^^370 the dispatcher 214 detects a fault," the dispatch'e^^ 214 calls the 
corresponding cartridge execution engine 228 in step 372 to abdrt the instance 260 having the 
fault. The corresponding cartridge execution engine 228 in turn issues a shut down command 



BNSDOCID: <WO_9923784A3JB> 



.Vr-jW-^'^^ ' ■ PCr/US98/226S6 

-23- 

^ across the API to the faulty instance. The instance; re^onding to the shut down command by 
t^e cai^dge execution engine 228, will shut down without affecting any^ther process in any 
other address space. . . 

If in step. 370 no fault is detected, the dispatcher 2 14 receives a reply from the instance 
5 260 upon completion of execution in stgj 374. The dispatdier 214 in step 376 forwards the 
reply to the listeqer,210,^which responds to ±e browser with the reply fiom^the executed 
instance 2^.0.. After executing the instance 2.60, the dispatcher 214 in step 378 maintains the 
instance in the memory, zs shpwn in step 378 to enable execution of a subsequent -request. 

10 ^ DISTRIBUTED ARCHITECTURE OF WEB.SERVER 

.Significantly, the, various cpmponents of the web application server 280 communicate 
with each other using a cpmmunicatipn mechani^. that does not require the- components to be 
^ executing in the same, address-space.or even on the same, machine. In the illustrated ^ 3c 
embodiment, the co^porients of the weh application server 280 are configured to . ii* 
15 communicate through an . Object. |lequest Broker (ORB) 282. Object Request Brokers ar^ 
. . described in detail in "Coininon Object ,R Broker: Architecture' and Specification 
.. (COR?A)",. This and other docjune^ts relating to CQRBA ean.be found on the World Wide 
■Web at http://www.omg..org . , , - • 

20 communications through a CORBifi-K:^ . . 

mechani?ms„may be uspd. -For example, the components of \yeb application, sender 280 may 
alternatively coimmunicate with each other using Remote Procedure Galls (RPC), a UNIX 

. . pipe, Microsoft COM. , . . , ,^ . : . • • - ; • ■ x 

Because the various components of tiie web ^plicatipn server ;280 communicate- with 

25 each other using a iiiachinei,independent cominunication mechanism, tihere are no inherent 
restrictions -with respect to where the components are located with respect to each other. For 
example, listeners 210, 2 16. and 222 may. be executing on the same machine, or on three, 
completely different machines, each with a different operating system. Similarly, the 
authentica^on seryer,?5?, virtual path nianager, 250, resource manager 254 and configuration 

30 provider 256 niay,be executiiig on the. same^machine or on fQur,4ifl55i«nt machines. Furtiier, 
: ^Pse four^different machmes may imt have any oyerlap witirthe tiiree m.achines executing 
listeners 210, 21.6. and.222.- . - ... - , , . > ...... 
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, . . Cjotridge execution engines 228, 232 and 236' incorporate all of the necessary logic to 
conununicate Avith the other components of the web ^plication server 280 through the object 
request broker 282. Consequentiy, the location of the cartridge instances themselves is not 
inherently restricted by the communic^tiQn mechanism. Thus, instance 260.may.be executing 
5 in a completely different machine and operating system than dispatchers from which it 
receives requests. Likewise, instance 260 may be on a different machine and operating 
system than the resource manager 254 or any of the other components of the web application 
server 280, including instances of other cartridges that are being managed by the same web 

application server 280. 
10 Significantiy, the location-independence enjoyed by cartridges used by web 

application server 280 is achieved through the cartridge execution engine communication 
logic, not through any custom programming in the cartridges themselves. Consequently, the 
cartridges do not need to be specially designed for execution in a distributed application server 
environment. Cartridge designers are thus insulated from the complexities of a distributed 

1 5 system, and can concentrate their efforts on the logic associated with the tasks for which the 
cartridges were created. 

As described above, a web application server 280 that manages multiple instances of 
different cartridges to process a variety of user requests is provided. Each cartridge instance 
executes in a separate memory space from the listener, tiiiis avoiding the security problems 

20 associated with server-side plug-ins. Further, the cartridge instances used to process the 

browser requests received by a listener may execute on entirely different machines than the 
Ustener. Thus, the scalability of the system is increased, while the burden on ariy particular 
machine is reduced. 

In addition, web ^plication server 280 also controls the number of instances for each 
25 given cartridge. Hence, server-side resources are controlled to ensure that a large number of 
requests do not overwhehn any machine by an uncontrollable generation of instances. 

Further, execution throughput also is improved by maintaining a minimum number of 
instances ready for execution. Additional mstances may be initiated and maintained in 
memory for executing subsequent requests, as opposed to terminating an instance after a 
30 single execution and then reloading the cartridge into memory in order to recreate an instance 
for execution of a subsequent request 

In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof It wiU, however, be evident that various modifications and 
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chaages may be made Aereto .witiiout departing from the broader spirit and^ scope of the 
invention. The specificiation and drawings are; accordingly, to be regarded in an illustrative 
.rather than a restrictiv-e sense. * - : - v .. .* 
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1 . A method for executing an operation, the method comprising the steps of: 
epcecuting a dispatcher on a first machine; - 

executing a resource manager on a second machine; 

sending a fu^ message fix)m the dispatcher to the resource manager, where the first 
5 - . emessage identifies a particular cartridge that is able to pefform said operation; 

sending a second message fi-om the resource manager to the dispatcher, where the 
second message identifies a.particMar ihstaiice of 
wh^e the particular instance is exeeutiiig o^^^ 
sending a third message fi-om the dispatcher to the particu&^^ 
10 " . particular instance to e^^ecute the operaiti^c^^^ 

wherein at least two of the first inacMne, the sefcohdmaclto^^^ the third machine are 
separate machines, - ■ ^ , ^ c ^ 

2. The method of Claim 1 fijilher comprising the stqjs of: - 
a browser sending a browser request to a web Ustener; 

15 the web Ustener passing &e browser r^bquest to -ffi^^^^^ 

wherein the dispatcher serids the first message in fespbnse to receiving the browser 
requbist fix)ni the web listend;' ^ * 

3. The method of Claiin 1 wherein:. ' 
. the first machine and the second machine are 

20 the step of sending a first message firom the dispatcher to the resource manager is 

' ; ; performed by sending the first message from the dispatcher to the resource 

manager through an obj ect request broker, ^d 
the step of sending a second message Scorn the resource manager to the dispatch^: is 
performed by sending the second message fipm the respurpe manager to the 
25 dispatcher through the object request broker. , . 

4. : * The method of Claiiii l wherein: : - 

the second machine and the third thachirie are se^ 
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the method includes the step of the resource manager causing the particular instance to 
begin execution on the third machine in response to the Tesoim:e manager 
receiving the first message. 

5. The method of Claim 1 wherein the resotu-ce manager determines which particular 
5 instance should perform the operation by performing the following rsteps in response to 

receiving the first message: . ^ ' , . ' - 

determining whether any instance of the particular cartridge is currently executing and 

imassigned;. ...J.. , .s , * ^ - ..^ . : - . - v 

if any instance of the pafticulaff; cardrdge is currently executing and unassigned, then 
10 ; identifying in^ ^axdjecond messaje a^i instance that is currently executing and 

unassigned;,. . v . . .[ ^ ? / - 

if no instance of the.particular cartridgejdentified. in. the first message is currently 
, ; : icxecutrng an^d imas^^ then initiating a new instance of the particular s^ 
cartridge and identifying said new instance in said second^message.^: 

15 6. The method of Claim 5 whCTisin, prior to initiating the new 
manager performs the steps of: ^ , 

inspecting metada^ta to determine a; set of machixies, including said third mtachine, that 

are able to executer5aid particular car^^ 
selecting said third machine to execute said npw instance of said particular cartridge. 

20 7. The method of Claim 1 further comprising the steps of: .- : " c 

causing said dispa-tcher to maintain a list of instances thgt have been assigned to said 
. . . dispatcher; and, * , . . - ^ - • 

in response to i^eceiving said second message, causing said dispatcher to update said 
list of instances to include an entry for said particular instance. 

25 8. The iriethod of Claim 7 wherein: 

"the list of instances includes data indicating whether the instances in said list are 
cxirrently busy; 

in response to sending said second message, the dispatcher indicates in said entry for 
said particular iiistance-that said particular iiigtance is bvtsy; 
30 the method further includes the step of the dispatcher receiving a fourth message fix>m 

said particular instance in response to said third message; and 
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.. . .inresponsetoTecei>^g-s^dd.fourth^message,tf^ 

• ; , indicate that said particular instance in not-cu^ 

> The method of Claim 8 , further cpniprisin^^ 

■ ■ the Watcher receiving a b^^^^ . 
performed by a seconci cartridge; ^. . , 
'the ispatcher inspecting said list of inst^^^^ 

entry for an instance of said second cartridge that is not currently busy; 
if the list contains ^ entry for an instance bfsaid^^^^^^^ 

busy, performing the steps of . - ^ ^ 

; , . the dispatcher sendinra fifth message to Wdp^^ 

, r sdd browser request to Wse said pa^^^ , 
second operation; and " " 
updating said entry to indicate that said particidar instance is currently, busy; 
if tiie list does not contain an entrj for an instence of said s^nd cartridge that is not 
currently btiy, striding a sixth message to said resourc^ manager to cause said 
resource manager to indicate ^ instance of sdds^^^^ 

said second operation. . .. 

10 The method of Claim 8 further comprising the steps of: 
, ^ determining when said particulaf -instancehas 
20 length of time; and ' ■ = 

when said particular instance has been idle for more than a predetennjne length of 
time, said dispatcher releasing said particul^^ 
manager. , 
11 AxOmputer-readablemediumcarTyingoneormoresequencesofim^^ . 
25 executing an operation, wherein execution of the one'br more sequences of instinictions 

by one or more processors causes tiie one or more proce^so^ tp perform the steps of: 
' executing a dispatcher on a first rnachine; ^ ■■ ^ '-'-^ - 

executing a resource manager on a second machine; , ^ ^ , , : 
sending a first message from tiie dispatcher to tiie resource mmger, wh^e the first 
30 'message idiiti'fies a particular cartridge tiiat is ^ble to pe^orm said operation; 



15 
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sending a. second message from the resource manager to the dispatcher, where the 
second message identifies a particular instance of the particular cartridge, 
where the particular instance is executing on a third machine; and 

sending a third message from tibe dispatcher to the particiilar instance to cause the 
particular instance to execute the operation; and ' 

wherein at least two of the first machine,* the second machine and the third machine are 
separate machines. 

12. . The computer-readable m : ? 

instructions for performing the steps of: - . , . * - - ' 
. a web listener passing a broAvser.request received from a browser to the dispatcher; 
vherein^the dispatcher sends the first message in response to receiving the browser > 
request fixDm the web listener. 



13. The computer-readable mediiim of a wherein: 

the first'niachine and the second machihe are separate machines; 

the step of sending a Gxst message from the dispatcher to the resource manager is 

perfoimed by sending flie first message from the dispatcher to the resource 

manager through an object request broker; and 
the step of sending a second message from the resource manage^ to the dispatcher^is 
f : , performed by sending the jsecond message Srom thexespurce manager to tHe 

dispatcher through the object request bratker, : o „ o : 

14. ' The computer-readable medium of CTaina 1 1 wherdn: 

the second ihacfiibe and the third machine are separate machines; and 
the computer-readable medium includes the step of the resoiirce manager causing the 
particular instance to .begin -execution on the third machine in response to the 
- ^ resoijrce malinger jeceivmg the first message. : 

15. The computer-readable medium of Claim 1 1 wherein the resource manager determines 
which particular instance should perform the operation by performing the following 
steps in response to receiving the first inessage: 

' detenriiriing whether any instance of the particular carbidge is cxurently executing and 
uiiassighed'; * - - , ^ - 
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... if any instance of the particular cartridge is currently executing and unassigned, then 
i , identifying in said second message an instance that is cu^ 

unasisigned; > ' 
if no instance of the particular cartridge identified in flie first message is currently 
5 . - executing and unassigned, then iiiitiatirig a new instance of the 

. . v ; cartridge and identifying said new instance in said second message. 

16. The computer-readable medium of Claim 1 5 wherein, prior to initiating the new 
instance, the resoxirce manager performs th? steps, of: . . 

inspecting metadata to detennme a set of maph^ 
10 are able to execute said particiilar cEutqdg?^^ 

selecting said third machine to execute said new,iAstance of said particular cartridge. 

1 7. The computer-readable medium of Claim 11 fiirth^ comprisi^^^ instructions for 
performing the steps of: Vv- ■ : . / : - 

causing said dispatcher to in^tain a list of instanc€S3 that have been assigned to said ^ 
15 dispatcher; and \ o 

in response to receiving said second message, causing^said dispatcher to update said 
Ust of instances to include an entry for said particular instance. 

18. The computer-readable medium of Claim 17 wherein: 

the list of instances includes data indic^ating whether the instances •m said^ist are: 
20 currently busy; 

m response to sending said second message^ the dispatcher indicates iii sajd entry for 

said particular instance that said particular instance is busy; 
the computer-readable medixim further includes mstructions to perform the step of the 
dispatcher receiving a fourth message froin said particular instance in response 
25 to said third niessage; and . ^ 

in response to receiving said fomth message, the dispatcher updates said entry to 
indicate that said particular instance in not currently busy. ^ 

19. The computer-tead:able medium of Clam 18 fi^ 
perfonniiig the steps of: 

30 ' the (tispatcher receiving k browser request that specifiies a second operation to be 
performed by a second cartridge; 
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. tiie dispatcher inspecting said list of instances to determine whether the list contains an 

; entry for an instance of said second .cartridge that is not currently bxisy; 

if the list contains an entry for an instance of said second cartridge that is not currently 
. busy, performing the steps of : . o 

the dispatcher sending a fifth message to said. particular instance in response to 
, ; said browser request to cause said particular instance to perform said 
second operation; and 
updating siaid entry to indicate that said particular instance is currently busy; 
if the list does not contain an entry for an instance of said second cartridge that is not 
currently busy , sending a sixth message to said resource manager to cause said 
resource manlageT tb indicate an instance of said second cartridge to perform 
said secotid opefration. " ^ - - 

. ' The computer-readable mediiim of Claim 1*8 further cbmprisihg instructions for 
performing the steps of: 

detennining when^saiid particular InStjafice'has been idle for more than a predeteimined 
length of time; and 

when said particular iiistance has been idl^ for more thaii a predetermine length of 

time, said dispatfcllbr releasing said particular instance to isaid resource * ■ • 

manager. , - , . ■ 

J. . * . , . ^, - . , \ ^ ' ■ ■ ^- , 

^A system for "perfonning operations assbciate^ 

comprising: ' ^ ' 

a plurality of dispatchers coiq>led to at plurality of web listeners, wh^eiri each 

dispatcher of said plurality of dispatchers rebeives fihom a corresponding web 

listener of said plurality of web listeners browser requests ireceived by said 

corresponding web listener ' " - 

a resource manager coupled to said plurality of dispatchers through an inter-machine 

communication mechanism that ^lows said resource manager' to communicate 

with said pWality of dispatchers withoiit regard to the machines on which said 

pluraUty of dispatchers reside, said reso\u:ce manager being configured to 

assign to each dispatcher of said plurahty of dispatchers,an instance of a 

cartridge of said plurality of carbidges in response to repjsiving.a.jequest for an 

instance fi"om said dispatch^;. . . 
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said plurality of dispatcHrars being configured to send messages through said inter- 
machine communication mechanism to the instances that are assigned by said 
resource manager to said dispatchers, said inter-machine cbmmuiiiw 
' . mechanism allowing said plurality of dispatchers to coimnunicalte with said 

5 . ; . instances without regard to the machines on which said instances reside, said. 

messages causing said instances to perfotto the operations associated with said 
browser requests. ■ "". 

22. the system of CMm 21 further- cbmprisiiig a Virtual path maixagCT coupled to said 
plurality of dispatchers through said iiite^m^hiiie corimiunicaiiori mechanism, said 

10 ■ ■ viitual piifli mihiia iiwaiatting 'to said^^Kspiafcliers Wlriah of a plurality of cartridges is 

associated with said browser requests. 

23. The system of Claim 21 whereinsaid inter-machine eommtmication mechmism is an 
. object request broker. ■ ' ' - - ; - - . 

24. The system of Claim 21 wherein tiie resource man^&er. is fiirther pgnfigured to initiate 
15 new instances of cartridges in response to messages from said 

■25! The system ofClaiin 24 whCTein, for each caotridge, said resource 

configured to maintain a number of executing instances between a predetermined 
minimum and a predetraimned maximum. - - : ; : ■ . . j. - ." . - . c i .- ^ r 

20 26. The system of Claim 21 wherein each dispatcher of said plurality of dispatchers is 

configured to maintain a list of instances tihat have been assigned to said dispatcher by 
said resource manager. 

27. The system of Claim 2 1 wherein, if a dispatchra- of said plurality of dispatchers 
receives a browser request asspciated with a particular cartridge, and the list of 
25 instances maintained by that dispatcher indicates that an instance of that particular 

cartridge is currently Wailable, then the dispatcher sends a message to the instance 
wi&out requesting an instance for the brpwser request fix)m .^^ 
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AMENDED CLAIMS 

[received by the Intematioiial Bureau on 1 July 1999 (01.07.99); 

' ' nriginal clajms 1 and 1 1 amended; liemainmg c^ims ^mcba"g^ Q P^C^)] 

1 . -r. A, method for executing an operatiozL, the metluKl conqnising the, stq>s t 
. executing a dispatcher <m a fixst machine^ 

to receive requests from clients and to distribute said requests to cartridges that 
are capable, of expiating said ipquests; 
5 executing a resource manager on a second machine: ^ - 

recci ving a request at said dispa^er trom a client executing on a n:iachine that is 

diffcrrat finom said first naa^^ 
in response to said (ti^atcher recdviikg said request, sending a first message firom the 

dispatcher to the resource manager, where Hic first message identifi^ a particular 
10 cartridge type that is able to perform said operation; 

sending a second menage fiom "the. resourccmanager to the dispatcher, Vi/bsrc the second 
message identifies a particular instance of the particular cartridge, where the 
particular instance is executing on a third machine; and 
sending a third liie^agf^ftbfn^l^^ 
15 particular instance to execute the o]^^^ 

wherein at least two of the fiist machine, the second machine and the thupd machine are 
separate machines. 

2- The method of Qaim 1 fixrtherconijpisingtihestisps of: ^ i - - 

a browser sending a browser request to a web listener; 
20 &c web listener passing the browser request to the dispatcher, 

wherein the dispatcher sends die first message in response to receiving the browser 
request fiom tHe web listener. 

3 . The method of Claim 1 wherein: 

the first machine and the second machine are separate madiines; 
25 the stejp of sending a first message firom the dispatcher to die resource manage is 

performed by sending the first message ftom the dispsOcher to the resoince 
x^[anager ti^ugh an otgedt request brol^ 
the stqp of sending a second message fiom the resoiuce manager tb tihe di^atcher is 
performed by sendixxg the second message fiom the resource manager to die 
30 dispatcher dirough the object request broker. 

AMENDED SHEET (ARTICLE 19) 
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: 'fee method fuxth^ indudes the step of fee dispatcher teceivtag a fourth message fiom 
■'bidpaiticularmstan^ 
in response to receiving said fourth message, the dispatcher updates said entry to indicate 

■ itot said particular instan^^^ 



10 



15 



The method of Claim 8 &rfc«- .compiiMng the steps of: 

the,dispatch« r«:eiying a Ws?^^ request that specifies a second operation to be 
perfonned by a second cartridge; a . . ^ 

the dispatcher inspecting said list of instpces to determine whether- the Ust contains an 
entry for an instance of said second cartridge that^is no^^^^^ 

if fee list contains an entry for an instance of said second c«tridge feat is not cmrenay 
bxisy/perfoniiing the St 

fee dispatcher sending a fifth message to said partiajaar instance in response to 

X > saidbrov^requesttb'cause«piticuIara^^ 

- second operation; and 
updating said entry to indicate that said pSrticuiar ins^tance is ciiireitly busy, 

if fee Ust does not contain an entry for an instance of said second c^dge feat is not 
currently busy,, sendmg a sixfe message to s^d.resouice manager to cause said 
resouice.manag^ to indicate an instanq? ?f faid^secqpd cartridge to perf^ said 
second operation. , . • ^ • • ■ - ' " 



20 10 The mefeod of Claim 8 furfeer comprising the steps of: 

detannning vvheri said particufek^ 

' length of time; and 
when said particular instance has been idle^^ knc^re fean a predetermine lengfe of time, 
said dispatcher releasiiig sdd particul^ instance to s^d reso^ 

25 11 A computerWable medium carrying ^«ie or more sequ^ of instructions fo^ 

executing an operation, wterein execution 6?the one or more sequences of instructions 
by one or more ^cessors causes the cine or more processors to p«rform fee steps of: 
executing a dispatcher on a first machine, wh^ein sdd di^atcher is an entity configured 
to recdve requests frprn cUen^s and to dis|;ibirte.said requests to cartridges feat 
30 are c^ableoffflceouting said . : ■ ' 

executing a resource manager on a second naacto; , , ^ . ; - . 
receiving a request at said dispatcher from a cUent executing on a machine feat is 
different firom said first machine; 
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in response to said di^atcher receiving said request, sending a first message fiom the 

dispatcher to the resource manager, whcrc the first message idendfi^ a particular 
; . ^. . cartridge type that ^ able to perform said op^ ; - - 

sending a second message fixm the rcsorape managea- to tiie dispatcher, where the second 
5 message identifies a particular instance of the particular cartridge, where the 

particxUar instance is'executing on a third niachine; and 
sending a third message from the dispatcher to tfaei particdlariiistancertd cause the 
particular iristance to execute the <ipemtion; arid • ' ' * ^ 
- wherein at least two of the first machine, the second machine and tiie third naachine are 
10 sq>arat'e naachines?'- ^'i- ^ ' - " 

12. The computer-readable medium of Claim 1 1 fiirther.cornprising instructions 
. forperfbnningthpste^^^ . • , . . . ^ 

. a^ jveb listener passm&a browser request received fix>m a brows^ to the dispatcher, 
wherein the dispatcher sends the first message in response to receiving the browser 
15 ^ request fe)m , the web listencr.^^ . , _ „ 

13. The con3^uter-read^ble medium . . 
the first inabhind arid the second machine are separaf-fe Tna/^liinftji; ' " 

tfie Step of sending a first message train the dfispatcher to iho resource manager is 
perfoimed by sending the first message &om flie dispatcher to the resource 
20 manager through an object request broker; and , - ^ . - . r 

. the step of sendnag a second message from the resourc^. manager to t^ie dispatcher is 
performed by sending the second message firom the resource niaoager to the 
dispatcher throu^ the ol)jj5Cj request brokCT . , , „ 

14. The computer-i^adable medium of Claim 1 1 wherein: 

25 the second madiine and the third tnachtneare separate machines; and ^ 

^ the coriq)uter-readdble medium includes the step of the resource manager cax^nS tb® 
particular instance to begin executipn on the third naachipe in resp<mse Jo tfie 
, respiirce Ina^ager receiving t^^^ ; 

15. The computer-readable medium of Claina 11 wherein the resource noianagef'detennines 
30 which particular instance should perform the op^tion by pCTforiiaing tiie following steps 

in response to receivtoig the first message: ^ - - ' - ^- - / 

AMENDED, SHEiET.i^^ 
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